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Abstract 

The  Air  Force  Engineering  and  Services  Center,  in 
conjunction  with  their  efforts  to  develop  a  performance  work 
statement  and  performance  measurement  for  each  Civil 
Engineering  function,  sponsored  this  research  to  develop  a 
method  of  evaluating  the  productivity  of  Air  Force  Fire 
Departments.  Using  the  tasks  developed  by  the  Fire 
Department  Workshop,  input  and  output  measures  were  defined 
and  used  in  a  new  model  of  efficiency  called  Constrained 
Facet  Analysis  ( CFA ) .  The  advantage  of  this  methodology 
over  others  considered  was  that  it  can  simultaneously 
evaluate  multiple  inputs  and  multiple  outputs  using 
empirical  data  with  no  "a  priori"  weighting.  The  results  of 
the  analysis  provided  an  efficiency  rating  for  each  fire 
department  and  information  about  marginal  rates  of 
substitution  and  marginal  rates  of  productivity  for 
inefficient  units  based  on  their  efficiency  frontiers. 

Though  the  current  CFA  model  has  some  dimensioning 
limitations  that  affected  the  depth  of  analysis  available, 
the  resulting  evaluations  gave  a  better  indication  of  the 
real  efficiency  of  individual  fire  departments  than  methods 
currently  used  and  also  gave  better  comparative  information 
to  be  used  in  budgeting  and  resource  allocation  decisions. 


The  CFA  model  continues  to  evolve  and  this  research 
validates  its  value  to  the  Air  Force.  Further  research  both 
in  Constrained  Facet  Analysis  and  its  application  to  other 
Civil  Engineering  functions  is  warranted. 


MEASUREMENT  OF  AIR  FORCE  FIRE  DEPARTMENT  PRODUCTIVITY: 
AN  EVALUATION  OF  EFFICIENCY/EFFECTIVENESS 


I .  Introduction 


Background 

Interest  in  improving  efficiencies  within  the 
Department  of  Defense  (DOD)  was  reasserted  in  response  to  a 
Reagan  Administration  program.  The  application  of  the 
Office  of  Management  and  Budget  (OMB)  Circular  A-76, 
contracting  to  a  commercial  source,  had  already  effected  an 
increase  in  the  efficiency  of  many  functions  by  requiring 
that  they  compete  against  contractors.  The  thrust  of  the 
new  program,  then,  was  aimed  at  the  functions  exempt  from 
application  of  the  circular  and  the  objective  of  the  program 
was  to  achieve  like  increases  in  the  efficiencies  of  these 
functions.  The  program  directed  within  the  Air  Force  is 
called  the  Air  Force  Functional  Review  Program.  It  requires 
all  functions  to  prepare  a  Performance  Work  Statement  and  a 
Quality  Assurance  Plan  to  promote  efficiency  and 
effectiveness  (1:2-8). 

The  Air  Force  Engineering  and  Services  Center  ( AFESC ) 
was  tasked  by  Major  General  Clifton  D.  Wright,  Director  of 
Engineering  and  Services,  HQ  USAF,  to  be  the  Office  of 
Primary  Responsibility  for  the  functional  review  for 
Engineering  and  Services.  They  approached  the  review  as  an 


1 


opportunity  to  improve  management  and  productivity  and  named 
the  program  Project  "IMAGE"  (Innovative  Management  Achieves 
Greater  Effectiveness).  Project  "IMAGE"  began  by 
concentrating  on  the  Fire  Department,  one  of  the  most 
difficult  organizations  to  evaluate. 

Problem  Statement 

The  AFESC  Fire  Department  functional  review  workshop 
was  completed  on  30  June  1983.  The  performance  work 
statement  and  quality  assurance  plan  for  this  function  were 
developed  and  generally  accepted  by  Fire  Department 
representatives  present  at  the  workshop  (attendance  list  is 
contained  in  Appendix  A).  However,  even  though  inputs  and 
an  exhaustive  list  of  tasks  shown  in  Appendix  B  were 
identified  for  each  function  within  the  Fire  Protection 
Branch  (Technical  Services,  Operations  and  Management),  the 
group  did  not  agree  on  common  outputs,  nor  did  they  identify 
a  model  which  could  adequately  guide  them  to  more  efficient 
operations. 


Research  Objectives 

With  the  sponsorship  of  the  Management  Division  and  the 
cooperation  of  the  Fire  Protection  Group  of  the  Engineering 
and  Services  Center,  this  research  will  use  the  measurement 
criteria  developed  at  the  Fire  Department  functional  review 
workshop  to  address  the  following  objectives: 


1 )  To  collect  historical  data  on  the  measures  of  Air 
Force  Fire  Department  inputs  and  outputs  that  are  thought  to 
be  likely  ingredients  of  or  influences  on  Civil  Engineering 
Fire  Department  productivity;  and 

2)  To  analyze  this  data  using  the  Constrained  Facet 
Analysis  model  to  determine  whether  or  how  each  data  item 
relates  to  productivity. 

3)  To  theorize  how  Constrained  Facet  Analysis  can  be 
integrated  into  an  automated  management  system  to  assist  the 
Fire  Chief  in  evaluating  both  efficiency  and  effectiveness 
of  his  Fire  Department. 

Research  Questions 

In  support  of  these  objectives,  four  research  questions 
must  be  answered: 

1 )  Can  a  comprehensive  set  of  inputs  and  outputs  be 
specified  to  form  a  complete  representation  of  Air  Force 
Fire  Department  functions? 

2)  After  reviewing  the  ratio  analysis,  linear 
regression.  Data  Envelopment  Analysis,  and  Constrained  Facet 
Analysis  models,  does  the  Constrained  Facet  Analysis  model 
provide  the  best  efficiency  model  for  analyzing  this  data? 

3)  Do  analysis  results  lead  to  recommendations  for 
operational  improvements? 

4)  How  can  each  level  of  management  best  use  the 
results  of  this  analysis  to  improve  efficiency  and 


effectiveness? 


Scope.  Limitations  and  Definitions 


This  research  will  evaluate  the  productivity  of  Air 

Force  Fire  Departments  using  a  definition  of  productivity 

which  is  a  combination  of  efficiency  and  effectiveness 

concepts.  DODI-5010.34  provides  definitions  of 

productivity,  effectiveness,  and  efficiency  for  use  within 

the  Department  of  Defense  (DOD). 

Productivity:  The  efficiency  with  which  organizations 
utilize  all  types  of  fund  resources  (operating  and 
investment)  to  accomplish  their  mission  represents 
total  resource  productivity.  The  efficiency  with  which 
organizations  utilize  labor  resources  to  accomplish 
their  missions  represents  labor  productivity  [26:1]. 

Efficiency:  Efficient  means  accomplishing  the  right 
things  with  the  lowest  possible  expenditure  of 
resources  [26:1]. 

Effectiveness:  Effectiveness  means  accomplishing  the 
right  things  in  the  right  quantities,  at  the  right 
times  [26:1 ] . 

These  definitions  overlap  to  some  degree  which  might  be 

confusing  to  the  reader;  therefore,  the  following 

definitions  are  offered  to  help  clarify  these  concepts: 

Productivity:  a  combination  of  efficiency  and 
effectiveness . 

Efficiency:  producing  the  greatest  results  with 
minimum  waste  of  resources  (Output/Input). 

Effectiveness :  the  ability  to  attain  the  goals  of  the 
organization. 

The  method  of  evaluating  productivity  will  be  to  first 
quantitatively  measure  the  efficiency  of  a  Fire  Department. 
Then  Fire  Protection  experts  will  use  their  own  expertise 
and  judgement,  guided  by  applicable  Air  Force  regulations. 


to  determine  the  effectiveness  of  the  unit.  The 
productivity  of  the  unit  will  thus  reflect  both  the  ability 
to  perform  the  mission  and  the  ability  to  best  utilize 
available  resources  to  do  so. 

Limitations  and  assumptions  applied  to  the  project  are: 

1 )  The  basic  goal  of  Fire  Protection  is  to  protect 
life  and  property  and,  in  Air  Force  Fire  Protection,  to 
support  the  flying  mission.  This  goal  will  not  be 
compromised;  effectiveness  must  have  higher  priority  than 
efficiency. 

2)  The  Fire  Department  is  a  part  of  the  Civil 
Engineering  organization  and,  as  such,  must  be  concerned 
with  budget  and  personnel  constraints  applied  to  Engineering 
and  Services. 

3)  In  the  fiscal  climate  of  the  DOD  in  the  1980's, 
resources  are  limited  and  every  organization  must  evaluate 
how  to  best  use  the  available  resources  to  accomplish  the 
mission. 

4)  The  decision  making  unit  for  the  evaluation  is  a 
base  level  Fire  Department,  though  the  Major  Commands  will 
use  the  results  for  their  decisionmaking  as  well. 

5)  The  database  will  be  limited  to  those  Continential 
United  States  (CONUS)  bases  which  operate  using  an  in- 
service  work  force,  not  including  Air  Force  Reserve  units. 

6)  All  operations  firefighters  work  a  72  hour  work 
week  and  Fire  Departments  are  manned  at  a  constant  rate  high 


enough  that  total  authorized  versus  assigned  manning  is  not 
a  factor  affecting  efficiency. 

7)  The  results  of  this  research  may  be  used  by 
Engineering  and  Services  to  improve  productivity,  but  not  to 
penalize  or  threaten  the  managers  and  organizations 
involved. 


II.  Literature  Review 


To  appreciate  the  complexity  of  the  problem  that  the 
research  addresses,  a  review  of  the  literature  in  two  topic 
areas  is  necessary.  An  examination  of  the  results  of 
research  in  the  area  of  public  sector  fire  service 
productivity  and  of  how  productivity  has  been  addressed  in 
government  (particularly  the  Department  of  Defense  and  the 
Air  Force)  will  be  presented  in  this  chapter. 

Productivity  in  Fire  Service 

Controversy  over  the  definition  of  productivity  and  its 
relationship  to  efficiency  and  effectiveness  extends  into 
public  service  agencies,  including  the  Fire  Service.  The 
need  for  some  type  of  measurement  and  the  lack  of 
identifiable  methods  is  evidenced  in  the  literature. 

Charles  P.  Shannon,  in  his  article  entitled  "Fire 
Service  Administrators  Find  New  Tools  to  Measure 
Performance,"  includes  two  comments  on  reasons  for  the 
current  emphasis  on  productivity.  "As  professional  and 
political  demands  for  performance  accountability  accelerate, 
the  need  for  statistically  measureable  performance  criteria 
will  become  essential  to  fire  administrators  "  (33:52). 
Furthermore,  "fire  service  administrators  are  now  expected 
to  know  what  their  citizens  are  getting  for  their  tax  money 
and  be  able  to  demonstrate  these  facts  to  others"  (33:52). 
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"Every  good  chief  would  like  to  know  what  composition 
of  forces  and  what  total  resources  will  minimize  the  overall 
cost  to  the  citizen  while  fulfilling  his  responsibility  for 
fire  protection"  (32:iv-v).  The  foregoing  statement  by  John 
T.  O' Hagen,  Fire  Commissioner,  Fire  Department,  City  of  New 
York,  describes  the  general  feeling  of  responsibility  within 
the  Fire  Service.  Other  experts  in  the  field  have  agreed: 

The  fire  service  mission  is  traditional  and 
enduring:  to  prevent  fires  and  to  respond  to 
those  that  do  occur  and  put  them  out.  Perhaps  more 
than  any  other  municipal  service,  the  fire  service  is 
linked  by  a  sense  of  fraternity  and  tradiwion,  the 
keystones  of  which  are  reliability,  dedication,  esprit, 
heroism,  and  self-sacrifice  [14:4]. 

"No  major  organization  is  more  strongly  tied  to  tradition 

and  resistant  to  change  than  the  fire  service"  (39:51). 

They  are  especially  iil-eqipped  to  undertake 
efforts  that  involve  more  than  minimal  technological 
uncertainty  and  risk.  The  rewards  for  success  within 
the  organization  are  too  small,  and  the  price  of 
failure  disproportionately  high  [14:6]. 

Despite  the  penalties  for  organizational  failure,  the 

growing  money  crunch  in  local  governments  will  force  the 

fire  chiefs  to  prioritize  budget  requirements  and  determine 

where  limited  resources  will  be  allocated,  to  people  or 

hardware  (14:6,  31:50).  The  decision  seems  obvious. 

Salaries  and  benefits  constitute  over  98%  of  the  fire 
department  budget,  and  it  is  here  the  cost  battle  must 
be  decided.  Any  significant  reduction  in  costs  must 
therefore  involve  a  cut  in  numbers  of  people  [39:52], 

Arthur  J.  Swersey  and  Edward  Ignall  conducted  a  review 

of  the  research  performed  in  the  fire  service  area.  On  the 

specific  topic  of  effectiveness,  they  found  that  very  little 


is  known  about  how  fire  losses  are  affected  by  fire  protec¬ 
tion  strategies  (prevention,  inspection,  adherence  to  codes, 
early  detection,  sprinklers,  fire  department  operations)  and 
environmental  factors  (building  construction  and  occupancy). 
They  also  asserted  that,  with  the  increasing  costs  of  fire 
protection,  the  need  to  measure  effectiveness  becomes  more 
important  (35:73). 

The  research  in  fire  service  develops  many  different 
definitions  of  the  basic  concepts  of  efficiency, 
effectiveness,  and  productivity  and  of  their  relationship  to 
each  other  in  fire  protection. 

It  is  difficult  to  measure  effectiveness  but  if 
one  assumes  that  codes  are  designed  to  prevent  or  limit 
fires  and  to  provide  life  safety,  and  the  code  is  being 
enforced  to  the  extent  that  available  resources  allow, * 
a  degree  of  effectiveness  must  be  assumed  [30:30]. 

One  measure  of  effectiveness  is  how  well  inspectors 
achieve  compliance.  This  includes  not  just  first-time 
violations  that  are  noted  and  corrected,  but  violations 
that  stay  corrected  [30:27], 

Fire  protection  is  optimized  when  the  costs  of  fire 
protection  plus  the  losses  due  to  fires  are  minimized 
[40:13], 

The  best  indication  of  cost  effectiveness  is  the 
combined  cost/loss  index  [38:29]. 

The  actual  effectiveness  of  fire  departments  is  to  a 
large  extent  a  function  of  their  capital  intensity, 
quality  of  capital  equipment  it  operates,  quality  of 
labor,  and  the  relation  between  them  expressed  as  a 
ratio  of  men  to  machines  [23:56], 

An  approach  by  Philip  B.  Coulter  attempted  to  relate 
the  three  elements  of  effectiveness,  efficiency,  and 
productivity. 


Effectiveness  is  defined  as  the  extent  to  which  the 
fire  service  avoids  or  reduces  property  loss,  death, 
and  injury  due  to  fire.  Prevention  effectiveness 
refers  to  the  degree  to  which  the  fire  service  avoids 
or  minimizes  the  incidences  of  fires.  ...  Productivity 
then,  measures  the  cost  of  varying  levels  of  effective¬ 
ness  by  combining  effectiveness  and  efficiency,  which 
are  theoretically  independent  [22:67], 

Philip  S.  Schaenman,  in  his  measurement  of  productivity  in 
fire  protection,  describes  productivity  as  the  output 
delivered  relative  to  the  amount  of  input  resources  used, 
where  output  includes  consideration  of  the  quality  and 
effectiveness  of  the  service  as  well  as  the  workload  (32:1). 

John  A.  Campbell,  chairman  of  the  Fire  Services  and 
Technology  Educators  Section  of  the  National  Fire  Protection 
Association,  says  that  one  of  the  major  difficulties  in 
determining  fire  services  cost  effectiveness  is  the  lack  of 
standard  performance  levels  for  fire  suppression  (16:19). 

Paul  E.  Andrews  and  John  H.  Erickson,  at  a  volunteer 
fire  council  meeting,  echoed  Campbell's  concern.  They 
stated  that  performance-based  results  must  be  reorganized  by 
state,  federal  and  insurance  organizations  and  that  stan¬ 
dards  must  be  established  based  on  the  expected  level  of 
proficiency  for  the  requirements  of  the  community  (3:44). 
Campbell  agrees  with  the  necessity  of  determining  the 
optimum  level  of  service  desired  by  the  community  and 
further  states  that  the  fire  service  professionals  must 
determine  the  optimum  way  to  provide  this  service  within 
economic  constraints  (16:19). 


Despite  the  recognized  need  for  guidance,  Daniel  Z. 


Czamanski,  in  his  study  on  the  cost  of  preventative 
services,  found  that  "pieces  of  analysis  on  fire  fighting 
are  scattered  among  the  various  taxonomic  studies  but  do  not 
represent  attempts  to  build  models  and/or  develop  and  test 
theories"  (23:20).  Swersey  and  Ignall  agree  with  Czamanski 
and  provide  seven  general  conclusions  about  fire  service 
research. 

1 )  Research  that  is  related  to  local  government 
policy  decisions  is  sparse; 

2)  The  quality  of  work  is  low,  with  some  notable 
exceptions ; 

3)  Little  is  known  about  fire  protection 
effectiveness; 

4)  Little  of  the  work  is  carried  through  to 
completion  and  implementation; 

5)  Better  data  are  required,  but  -  more 
importantly  -  a. clear  sense  of  what  to  do  with  these 
data  is  needed; 

6)  Research  goals  are  often. neither  well-defined 
nor  clearly  understood;  and 

7)  Sound  statistical  procedures  are  usually 
lacking  [35:72]. 

The  research  that  has  been  conducted  on  fire  service 
productivity  and  the  results  of  that  research  are  summarized 
and  examined  in  Chapter  IV,  Methodology,  of  this  report. 


Productivity  in  Government 

In  public  organizations,  productivity  improvement  has 
taken  on  increased  importance  as  the  demand  for  services  has 
increased,  while  supporting  tax  revenues  have  lagged  behind. 
Due  to  the  absence  of  a  widely  accepted  definition  of 
productivity  and  the  limited  number  of  adequate  criteria 
for  measuring  productivity  in  the  public  sector,  very  few 
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studies  have  attempted  a  quantitative  analysis  of  government 
productivity  (36:1,  23:16-17).  The  studies  that  have  been 
accomplished  offer  a  myriad  of  outlooks  on  government 
productivity. 

A  study  by  Charles  J.  Burkell,  regarding  productivity 
in  governmental  agencies  states: 

By  definition,  productivity  is  a  measure  of 
something  provided  by  nature,  industry,  or  art.  The 
measure  evaluates  goods  and  services  produced  (outputs) 
in  contrast  to  the  amount  of  resources  utilized 
(inputs).  At  some  point  in  the  measure,  a  so  called 
level  of  efficiency  is  established,  which  determines 
whether  the  activity  is  productive,  nonproductive,  or 
even  counterproductive  [15:25]. 

He  further  explained  that  "we  should  consider  the 
concept  of  productivity  as  a  relationship  of  resources  to 
products  and  services,  and  then  try  to  determine  the 
effectiveness  of  that  relationship"  (15:25). 

In  another  report  by  Thomas  C.  Tuttle  (37),  a 
comprehensive  annotated  bibliography  of  the  literature  on 
productivity  measurement  and  enhancement  was  compiled  from 
automated  and  manual  searches  of  journals  and  computerized 
data  bases.  Most  frequently,  the  interpretation  of 
productivity  depends  on  the  profession  from  which  it  is 
approached.  Tuttle  categorized  the  productivity 
bibliographies  into  five  categories:  1)  the  economist's 
view,  2)  the  engineer's  view,  3)  the  accountant's  view,  4) 
the  manager's  view,  and  5)  the  industrial/organizational 
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psychologist's  view.  He  concluded  by  stating  the  official 
Air  Force  view  of  productivity.  Each  is  summarized  below. 

The  Economist's  View.  Productivity  =  Outputs / Inputs . 
This  definition  of  productivity  is  based  on  production 
theory  and  typically  states  the  ratio  of  outputs  to  inputs 
in  real  or  physical  terms  (37:7). 

The  Engineer's  View.  Efficiency  =  Useful  Work/Energy. 

The  engineering  approach  grows  out  of  the  normal  expression 
for  the  efficiency  of  a  machine  (37:8).  Norman  and  Bahiri 
(37:8-9)  expanded  this  definition  by  considering 
productivity  as  synonymous  with  efficiency.  In  developing 
their  efficiency  relationships,  they  made  a  distinction 
between  useful  output  and  actual  output  and  also  between 
actual  input  and  potential  input. 

The  Accountant's  View.  Accountants  view  productivity 
as  business  efficiency.  They  are  concerned  with  monitoring 
financial  performance  within  an  organization  using  a  series 
of  financial  ratios  (37:9-10). 

The  Manager's  View.  In  1975,  Katzell,  Yankelovitch, 
Fein,  Ornati,  and  Nash  (37:10)  surveyed  two  groups  of 
managers:  1)  Chief  of  Executive  Officers  and  2)  Industrial 

Relations  Officers.  In  the  survey,  randomly  selected 
managers  from  both  groups  were  asked  to  indicate  their 
agreement  or  disagreement  with  a  number  of  possible 
statements  concerning  the  meaning  of  productivity.  The 
results  are  summarized  in  Table  2.1. 


TABLE  2.1 


Manager's  Definition  of  Productivity 


Productivity  definition  includes: 


%  Agreeing 


1 .  Quality  as  well  as  quantity 

2.  Output  per  manhour  in  one 

company  or  organization 

3.  Overall  efficiency  and 

effectiveness  of  the 
operation 

4.  Disruptions,  "shrinkage", 

sabotage  and  other  troubles 
even  if  they  are  difficult 
to  measure 

5.  Rate  of  absenteeism  and 

turnover  as  well  as  output 

6.  Customer  or  client  satisfaction 

7.  Employee  loyalty,  morale,  or 

job  satisfaction 

8.  Ratio  of  output  to  input  by 

industry  or  sector  of  the 
economy,  but  not  by  individual 
organization 


95 

90 

88 

73 


70 

64 

55 

22 


(Reprinted  from  Productivity.  Measurements:  Classification. 
Critique,  and  Implications  for  the  Air  Force  [37:11]) 


Tuttle's  conclusions  from  this  survey  were  that  managers 
tend  to  consider  productivity  to  be  a  broad  concept  and  that 
the  engineer's  concept  or  economist's  concept  is  too  narrow 
for  this  general  use  (37:11). 

The  Industrial/Organizational  Psychologist's  View.  The 
term  "productivity"  is  often  found  in  the  literature  of 
iniustrial/organizational  psychology,  where  its  meaning  is 
usually  vague  (37:12). 


4 


One  organizational  view  of  productivity  is  given  by 


Katz  and  Kahn.  "Katz  and  Kahn  in  their  classic  description 
of  a  systems  view  of  organizations  define  productivity  as  a 
'measure  of  role  performance.*  ...  These  authors  viewed 
productivity  as  a  measure  of  the  output  of  an  individual  in 
his  or  her  work  role"  (37:12). 

Psychologists  and  other  organizational  researchers  have 
typically  given  more  attention  to  organizational 
effectiveness  than  to  productivity.  While  the  concept  of 
effectiveness  is  related  to  productivity,  the  nature  of  this 
relationship  is  often  implicit  and  confused  (37:12). 

Campbell  et  al.,  in  their  review,  considered  both 
productivity  and  efficiency  as  dimensions  of  organizational 
effectiveness.  Coulter  expressed  another  view  of  the 
relationship  between  productivity  and  effectiveness.  In 
this  view,  productivity  is  the  integrating  concept  that 
links  effectiveness  and  efficiency  (37:16).  A  third  view 
has  been  prepared  by  Price  who  says  that  productivity 
(efficiency)  is  separate  from,  but  related  to  effectiveness. 
He  goes  on  to  say  that  the  two  can  vary  independently  and 
this  is  sometimes  the  case  in  business  (37:17). 

Productivity  in  the  Department  of  Defense  and  the  Air  Force 

"Largely  because  of  pressure  on  the  Military  Services 
to  justify  budget  requests,  concern  about  productivity  has 
increased  in  the  Department  of  Defense  (DOD),  particularly 
in  the  Air  Force"  ( 37 : i ) .  DOD  Instruction  5010.34  (August 


that  each  DOD  component  develop  approaches  to  productivity 
enhancement.  They  also  put  forth  three  separate  definitions 
of  productivity,  one  in  terms  of  both  efficiency  and 
effectiveness  and  two  that  relate  productivity  only  to 
efficiency  (37:21).  "Thus  the  DOD  definition  is  unclear" 
(37:21 ). 

When  the  Air  Force  issued  its  Productivity  Plan  in 
November  1979  in  response  to  the  DOD  requirement,  it  adopted 
the  narrow,  efficiency  definition  of  productivity.  Though 
the  plan  acknowledged  effectiveness  as  achieving  a  goal  or 
objective,  the  main  focus  was  still  on  efficiency  (37:21). 

Air  Force  Civil  Engineering's  efforts  to  develop  a 
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Air  Force  Fire  Protection 


Chapter  II  presented  the  complexity  of  defining 
productivity  in  the  public  sector,  particularly  in  the  fire 
service.  The  literature  also  stressed  the  need  to  develop 
performance  standards  within  this  function  in  order  to 
operate  more  efficiently.  The  difficulty  of  measuring  fire 
protection  performance  is  amplified  when  the  function  is 
military.  A  fire  department  in  the  public  sector  rarely  has 
the  combined  responsibility  for  aircraft  crash  rescue  and 
firefighting  and  structural  fire  protection.  When  a  single 
manpower  pool  must  be  trained  and  ready  to  respond  to  both 
these  areas  of  responsibility,  as  well  as  maintain  a 
readiness  posture  for  a  wartime  deployment  mission,  the  task 
of  setting  standards  becomes  even  more  challenging.  To 
clarify  this  challenge,  an  overview  of  the  missions  and 
structure  of  Air  Force  fire  protection  is  presented  in  this 
chapter. 

Air  Force  Civil  Engineering  will  provide  fire  services, 
including  the  management  of  fire  protection  and  prevention 
programs,  and  the  execution  of  fire  suppression  in  support 
of  the  Air  Force  mission  (1:22).  The  Air  Force  Fire 
Department  is  therefore  designed  to  provide  resources  for 
aircraft  crash  rescue  and  firefighting,  and  fire  protection 
for  Air  Force  buildings  and  facilities.  The  structure  of 
the  Air  Force  Fire  Protection  Program  is  shown  in  Figure  3.1 
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Figure  3.1.  Air  Force  Fire  Protection  Program 


The  interest  in  fire  protection  stems  from  the  need  to 
protect  a  wide  variety  of  operational  resources  in  support 
of  the  basic  flying  mission.  These  resources  include 
aircraft,  buildings,  equipment,  supplies,  information,  and 
personnel.  With  this  in  mind,  the  installation  program 
structure,  shown  in  Figure  3.2,  divides  the  base  fire 
department  into  these  categories: 

1)  Operations,  which  includes  aircraft  crash,  fire  and 
rescue,  and  structural  fire  and  suppression; 


2)  Technical  Services;  and 

3)  Management. 
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Figure  3.2.  Individual  Installation  Fire  Protection  Program 

Operations 

The  operations  function  of  the  fire  department  has 
three  objectives  when  responding  to  an  aircraft  or 
structural  fire  incident: 

1 )  Save  lives  and  property; 

2)  Recover  resources;  and 

3)  Increase  aircraft  or  facility  salvage  value  (24:6). 
The  fire  department's  first  responsibility  is  to  save  lives. 
"All  initial  fire  fighting  efforts  will  be  expended  to 


provide  a  habitable  environment  and  an  exit  for  entrapped 
persons"  (24:6).  Several  factors  influence  these  objectives 
and  must  be  considered  when  trying  to  determine  productivity 


measures  in  the  operations  function.  Three  of  these  factors 
include: 

1 )  assessibility  to  the  mishap; 

2)  time  of  arrival;  and 

3)  the  amount  of  fire  department  resources  that  can  be 

used. 

These  factors  are  heavily  influenced  by  the  number  and 

location  of  fire  stations  on  an  airbase.  "One  Air  Force 

objective  is  to  consolidate  fire  departments  into  single 

adequate  combination  crash  and  structural  stations"  (24:7). 

The  vehicles  assigned  to  each  station  are  determined  by  its 

location  (structural  or  crash  mission  area).  In  the  case  of 

crash  mission,  the  number  and  type  of  vehicles  is  based  on 

♦ 

the  type  of  assigned  mission  aircraft.  Structural  vehicle 
authorizations  depend  on  a  combination  of  fire  flow 
requirement  (amount  of  water  to  extinguish  a  fire)  and  time- 
distance  criteria  for  outlying  locations  (24:31). 

Fire  fighting  personnel  are  authorized  based  on 
assigned  vehicles.  The  combination  of  the  crash  and 
structural  requirements  is  carried  into  firefighter  manning 
by  the  cross-staffing  concept.  "Full  cross-staffing  means 
that  firefighters  assigned  to  operate  one  major  piece  of 
equipment  are  used  to  operate  another  piece  of  equipment 
intended  to  be  used  to  meet  another  mission  need"  (24:6). 

In  peacetime,  however,  both  the  crash  and  structural 
equipment  are  staffed  to  a  certain  extent. 


Technical  Services 


Each  Air  Force  installation  is  required  by  regulation 
to  establish  a  fire  prevention  program.  Fire  education  to 
the  base  population  is  stressed  to  enhance  the  total  fire 
prevention  effort.  The  objectives  of  fire  prevention  are 
twofold: 

First,  eliminate  the  cause  of  fire,  and  second,  reduce 
the  loss  of  life,  injuries,  and  property  damage,  if 
fire  occurs.  Achievement  of  these  objectives  requires 
command  support  at  all  levels  and  participation  in  the 
program  by  all  base  personnel.  It  also  requires 
identification  of  deficiencies  and  hazards,  and 
priority  projects  for  their  correction  [24:35]. 

To  accomplish  these  goals  and  to  achieve  effective  fire 

prevention,  a  well-planned  program  managed  by  the  fire  chief 

is  required  (24:8).  In  this  program,  the  installation 

commander  enforces  the  requirements  of  the  program,  base 

personnel  execute  policies  and  procedures,  and  technical 

services  personnel  (from  the  fire  department)  perform  fire 

prevention  education  and  quality  control  and  monitor  the 

effectiveness  of  the  program  (24:8). 

For  the  fire  prevention  program  to  be  meaningful  and 

effective,  three  basic  principles  must  be  recognized  and 

used  to  develop  the  overall  philosophy  of  the  installation 

fire  prevention  program: 

a.  Provide  fire  prevention  education  for  the  base 
population. 

b.  Make  sure  that  the  proper  fire  protection 
requirements  are  included  in  activities  and  projects. 

c.  Enforce  fire  prevention  requirements.  If  specific 
Air  Force  guidance  does  not  exist,  use  NFPA 
publications  (24:35). 


Management 

"The  main  fire  protection  management  objective  is  to 
eliminate  the  causes  of  fire  and  reduce  loss  of  life, 
injuries  and  property  damage  if  fire  occurs"  (24:10). 

The  installation  commander  will  provide  and 
maintain  an  effective  fire  protection  program  that 
interfaces  with  the  overall  mishap  prevention  program. 
The  Base  Civil  Engineer  who  is  designated  the  Base  Fire 
Marshal,  administers  the  fire  protection  program 
[24:10]. 

The  fire  protection  organization  is  managed  by  the  Fire 
Chief  who  reports  directly  to  the  Base  Civil  Engineer. 

The  duties  of  the  Base  Fire  Chief  include  1 )  insuring 
that  vehicles,  equipment  and  personnel  are  always  ready  to 
operate;  2)  efficiently  using  available  resources;  and 
3)  insuring #that  base  plans,  regulations,  and  operating 
instructions  adequately  address  contingency  fire  operations  # 
(24:11).  He  is  assisted  in  these  duties  by  the  Deputy  Fire 
Chief,  the  Assistant  Chief  for  Operations,  the  Assistant 
Chief  for  Technical  Services,  the  Assistant  Chief  for 
Training  and  a  Station  Chief  for  each  fire  station. 

The  Contingency/Readiness  Role 

The  base  fire  department  is  an  essential  element  in 
developing  and  maintaining  the  readiness  posture  of  the 
"total  fire  protection  force  (active  duty  and  reserve  forces 
firefighters)"  (24:34).  The  fire  chief,  who  plays  a 
distinct  and  tangible  role,  both  in  peace  and  wartime, 
directly  affects  the  efficiency  of  a  contingency  operation. 
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He  is  responsible  for  managing  and  training  the  firefighting 
Prime  Base  Engineer  Emergency  Force  (BEEF)  teams  assigned  to 
his  base  in  accordance  with  AFR  93-3  (25),  Air  Force  Civil 
Engineering  Prime  Base  Engineer  Emergency  Force  (BEEF) 
Program. 

"A  key  concept  that  must  be  recognized  both  preparing 
for,  and  in  conducting  firefighting  operations  is  that  fire 
risks  will  increase"  (24:34).  Therefore,  the  demands  on  the 
firefighting  teams  that  deploy,  as  well  as  the  firefighters 
who  remain  at  the  home  station  to  continue  providing  fire 
protection  will  also  increase. 

The  two  specialized  firefighting  teams  established  for 
Prime  BEEF  are  the  Crash  Rescue/Fire  Suppression  Operations 
Team,  which  provides  fire  protection  and  crash  rescue  for 
contingency  situations;  and  the  Crash  Rescue/Fire 
Suppression  Control  Team,  which  provides  crash  rescue  and 
fire  suppression  command  and  control  (25:2-5).  When  the 
control  team  is  combined  with  two  or  more  operations  teams, 
the  aggregate  forms  a  base  fire  department  capable  of 
supporting  a  wartime  mission  (25:5). 

Fire  Protection  Training 

Fire  protection  training  is  a  vital  element  of  the  fire 


protection  program,  as  well  as  contingency  operations.  The 
training  program  ensures  that  firefighters  are  capable  of 
performing  effectively.  "Firefighter  proficiency  and 


effectiveness  are  obtained  through  quality  instructions, 
proper  scheduling,  demonstrated  performance,  and  evaluations 
to  determine  training  needs”  (24:8). 

Conclusion 

Air  Force  fire  protection  is  a  complex,  challenging 
function  that  involves  several  sub-activities  for  every 
major  one  that  is  addressed.  Any  performance  measurement 
system  will  have  to  incorporate  consideration  for  these  as 
well  since  they  are  an  integral  part  of  fire  protection 
activity. 


IV.  Methodolc 


The  main  objectives  of  this  study  are  1 )  to  collect 
historical  data  on  the  measures  of  Air  Force  Fire  Department 
inputs  and  outputs  that  are  thought  to  be  likely  ingredients 
of  or  influences  on  Civil  Engineering  Fire  Department 
productivity;  2)  to  analyze  this  data  using  the  Constrained 
Facet  Analysis  model  to  determine  whether  or  how  each  data 
item  relates  to  productivity;  and  3)  to  theorize  how 
Constrained  Facet  Analysis  could  be  integrated  into  an 
automated  management  system  to  assist  the  Fire  Chief  in 
evaluating  both  efficiency  and  effectiveness  of  his  fire 
department.  Prior  .to  the  analysis  of  data,  two  search 
questions  must  be  addressed: 

1 )  Can  a  comprehensive  set  of  inputs  and  outputs  be 
specified  to  form  a  complete  representation  of  Air  Force 
Fire  Department  performances? 

2)  Of  the  mathematical  models  reviewed  (regression, 
ratio  analysis.  Data  Envelopment  Analysis,  and  Constrained 
Facet  Analysis)  does  the  Constrained  Facet  Analysis  model 
provide  the  best  method  of  analyzing  the  data? 

Selection  of  Input/Output  Candidates 

Selection  of  inputs  and  outputs  for  this  research  will 
proceed  according  to  the  guidance  provided  by  Bessent, 
Bessent,  and  Clark  in  their  paper,  "Specif icaton  of  Inputs 


and  Outputs  in  Data  Envelopment  Analysis  (DEA)"  (9).'  An 
outline  of  this  procedure  is  provided  in  Figure  4.1. 


Current  Information  Available.  Reporting  for  Air  Force 

Fire  Departments  is  currently  extremely  limited.  AFR  92-1 , 

"Civil  Engineering  -  Fire  Protection:  Fire  Protection 

Program,"  requires  each  base  to  submit  quarterly  AF  Form 

1528,  Fire  Protection  Activity  Report  (Figure  4.2),  to  its 

Major  Command  (MAJCOM).  The  MAJCOM's  are  required  to 

consolidate  these  reports  and  submit  an  annual  MAJCOM  report 

to  AFESC.  Additionally,  AF  Form  278,  Fire  Incident  Report, 

is  required  for  all  fires  with  a  monetary  loss  to  property 

or  fires  that  cause  loss  of  life  or  disabling  injury 

(24:13,15).  It  should  be  noted  that  these  reports  cover 

only  what  the  Department  did  and  not  how  or  at  what  cost  it 

* 

was  done.  The  only  other  records  kept  by  the  Fire 
Department  are  the  Civil  Engineering  records  for  financial 
management  and  labor  reporting. 

Development  of  Input/Output  Candidates.  The 
participants  in  the  Fire  Department  functional  review 
workshop  (Appendix  A)  identified  an  exhaustive  list  of  Fire 
Department  tasks  which  are  listed  in  Appendix  B.  In  order 
to  facilitate  output  selection,  this  list  was  further 
partitioned  into  general  task  categories  for  each  of  the 
following  sub-functions:  Technical  Services,  Operations, 
and  Management.  The  selection  of  input/output  candidates 
for  this  study  was  accomplished  using  the  list  of 
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categories,  taking  into  consideration  the  current 
availability  of  data. 

At  this  stage  in  the  identification  process,  the 
candidates  must  meet  the  criteria  below  (9:3). 

1.  Outputs  represent  important  Fire  Department  goals. 

2.  All  measures  are  appropriate  and  common  to  all  Fire 
Departments  and  exist  in  nonzero  amounts. 

3.  Inputs  represent  all  the  physical  quantities  used 
by  the  units  towards  attainment  of  outputs. 

4.  There  is  a  conceptual  basis  for  believing  that 
changes  in  the  ouputs  should  be  caused  by  changes  in  the 
inputs. 

5.  The  magnitudes  of  physical  input /output  quantities 

are  represented.  , 

6.  <The  quality  of  inputs  and  outputs  is  represented. 
Additionally,  the  "isotonic"  property  (which  means  as  an 
input  increases/decreases  the  output  measure  should  also 
increase/decrease  and  vice-versa)  has  been  insured  by  using 
the  reciprocal  value  where  appropriate. 

Output  candidates  for  this  analysis  will  be  of  two 
types:  results  and  process  measures.  Results  measures  are 
stated  in  measurable  terms  and  are  related  to  an 
organizational  objective.  Included  in  this  category  are 
surrogate  or  proxy  measures.  These  quantifiable  measures 
represent  the  closest  feasible  representation  of  an 
achievement  that  is  not  itself  directly  measurable.  A 


process  measure  relates  to  an  organizational  activity  rather 
than  to  the  objective.  An  input  used  as  an  output  when  no 
other  measure  is  available  is  included  in  this  category. 
(4:232-233,  249) 

The  comprehensive  set  of  input  and  output  candidates 
selected  for  this  analysis,  presented  with  category 
justification  and  source  information,  are  in  Appendix  C. 
Chief  Master  Sergeant  Bryce  Mason,  AFESC  Fire  Protection 
Division,  reviewed  the  candidate  selections  and  validated 
the  appropriateness  of  the  measurements  (28).  He  also 
assured  that  these  factors  represent  a  complete  description 
of  the  Fire  Department  activities.  With  the  completion  of 
this  review,  the  assertion  can  be  made  that  the  first 
research  question,  to  collect  historical  data  oh  the 
measures  of  Air  Force  Fire  Department  inputs  and  outputs 
that  are  thought  to  be  likely  ingredients  of  or  influences 
on  Civil  Engineering  Fir  Department  productivity,  has  been 
positively  addressed. 

Alternative  Methods  of  Measuring  Air  Force  Fire  Department 
Efficiency 

The  literature  review  illustrated  that  fire  service 
productivity  is  multi-factored.  At  this  time,  a  method  has 


not  been  developed  which  combines  all  these  factors  into  one 
true  indicator  of  fire  service  productivity.  In  an  attempt 
to  fill  this  void.  Constrained  Facet  Analysis  (20)  will  be 


used  in  this  research  to  measure  the  relative  efficiency  of 
Air  Force  Fire  Departments. 

Constrained  Facet  Analysis  (CFA)  is  a  new  approach 
which  provides  a  range  of  efficiency  (an  upper  and  lower 
bound)  and  takes  into  account  the  relationship  between 
multiple  inputs  and  multiple  outputs  when  measuring  the 
relative  efficiency  of  a  decision  making  unit.  This  method, 
which  has  been  developed  by  Bessent,  Bessent,  Clark,  and 
Elam,  (11)  is  an  extension  of  the  Charnes,  Cooper,  and 
Rhodes  (19)  efficiency  model  called  Data  Envelopment 
Analysis  (DEA),  which  establishes  the  highest  possible 
efficiency  rating  for  a  decision  making  unit  based  on  the 
evaluation  of  empirical  data. 

A  detailed  discussion  of  both  Data  Envelopment  Analysis 
and  Constrained  Facet  Analysis  will  follow,  but  first,  a 
review  of  some  of  the  research  and  methods  employed  thus  far 
to  measure  fire  service  efficiency  and  their  shortfalls  will 
be  presented.  Although  substantial  research  has  not  been 
accomplished  in  the  field  of  fire  service  productivity,  it 
is  interesting  to  observe  that  the  research  that  has  been 
done  seems  to  be  aimed  in  multiple  directions.  This,  in 
part,  is  due  to  the  disagreement  by  fire  service  experts  on 
how  to  measure  fire  service  productivity. 

Arthur  J.  Swersey  and  Edward  Ignall  (35)  evaluated 
much  of  the  fire  service  research  done  through  1979.  They 
gave  the  topic  of  measuring  effectiveness  and  productivity  a 


high  priority  for  future  research,  affirming  that  little 
investigation  has  been  done  in  this  area  (35:67).  Their 
overall  assessment  of  the  research  performed  at  the  time 
identified  the  following  deficiencies:  1 )  that  quality 
data  was  lacking  and,  more  importantly,  a  clear  sense  of 
what  to  do  with  this  data  is  needed  (35:72)  (32:93);  and 
2)  sound  statistical  procedures  are  usually  lacking  in  the 
research  studies  (35:72). 

Mr.  Waters  reiterated  the  first  deficiency  after 
commenting  on  a  study  of  50  city  fire  departments  conducted 
by  a  consortium  of  the  National  Science  Foundation,  the 
National  Fire  Protection  Association,  the  International  City 
Management  Association,  and  the  Research  Triangle  Institute 
(39:52).  One  of  the  significant  features  in  this  benchmark 
study  is  the  use  of  nationwide  efficiency  and  productivity 
measures  to  judge  how  a  Fire  Department  compares  with 
others.  Waters  points  out  that  there  is  a  need  for 
empirical  measures  using  readily  available  data  (39:52). 

Of  the  mathematical  techniques  used  in  fire  service 
research,  the  ones  most  commonly  found  are  pairwise 
comparison,  ratio  analysis,  and  linear  regression.  In  the 
pairwise  comparison  measurement  method  developed  by 
Schaenman  and  Swartz ,  Schaenman  and  Swartz  noted  that 
interactions  between  resources  (inputs)  and  the  Fire 
Department's  services  (outputs)  were  not  taken  into  account. 
This  fact  caused  somewhat  misleading  conclusions  about  a 


fire  department's  efficiency  because  each  pairwise 
comparison  reflected  only  a  few  dimensions  of  the  fire 
protection  services  rendered,  when  several  measures  and 
factors  were  needed  to  describe  fire  prevention  and  fire 
suppression  efficiency  and  productivity  (32:14). 

Ratio  Analysis.  Charles  P.  Shannon,  Director  of 
Management  and  Human  Services  at  the  Denver  Regional  Council 
of  Governments,  conducted  a  research  study  identifying 
indicators,  in  the  form  of  ratios,  associated  with  the 
performance  of  fire  service  operations.  He  noted  that  first 
the  ratio  data  had  to  be  collected  and  then  the  data  had 
to  pass  the  tests  of  relevance,  timeliness,  accuracy, 
availability,  and  comparability.  He  further  pointed  out 
that  a  comprehensive  performance  measurement  system  that 
relies  on  ratios  and  comparative  data  will  undoubtedly  fail 
to  meet  all  of  these  tests  (33:55). 

The  limitation  of  ratios,  and  ratio  analysis  in 
particular,  is  provided  by  Bessent,  Bessent,  and  Clark  (6). 
Their  paper  identifies  the  benefits  and  shortcomings  of 
ratio  analysis  when  compared  to  Data  Envelopment  Analysis, 
and  their  major  points  will  be  presented  here.  Ratio 
analysis  is  a  simple  ex  post  facto  method  of  comparing  the 
performance  of  similar  organizations  with  multiple  inputs 
and  multiple  outputs.  Ratio  analysis  examines  these 
multiple  measures  in  the  form  of  ratios  that  are  familiar  to 
managers  and  that  are  easy  to  calculate  because  each  ratio 


is  typically  a  single  output  measure  divided  by  a  single 
input  measure. 

The  major  shortfall  of  ratio  analysis  is  that  it  does 
not  make  use  of  mathematical  models  which  take  into  account 
the  interactions  over  the  full  range  of  inputs  and  outputs 
simultaneously.  As  a  result,  ratio  analysis  cannot 
accurately  compare  the  performance  of  similar  organizations, 
particularly  when  an  organization  ranks  high  on  some 
measures  and  low  on  others  ( 6 ) . 

Bessent,  Bessent,  and  Clark  (6:15)  provide  a  useful 
discussion  of  the  following  ratios  by  using  illustrative 
examples,  and  they  also  discuss  the  problems  encountered 
with  each  ratio: 

1.  Percentages  (assigned  /  authorized) 

2.  Ouput  /  Input 

3.  Input  /  Output 

4.  Input  /  Input 

5.  Output  /  Output 

Basically,  the  information  obtained  from  these  ratios  is 
often  misleading  because  the  ratios  provide  only  a  partial 
measure  of  multiple  input,  multiple  output  relationships, 
resulting  in  erroneous  conclusions  about  productivity. 

Although  percentages  and  other  ratios  are  easily 
calculated  and  are  familiar  to  managers,  the  use  of  these 
measures  in  Constrained  Facet  Analysis  can  result  in  a 
failure  to  explictly  take  into  account  the  magnitudes  of  the 
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outputs  or  inputs  which  are  found  in  the  numerators  and 
denominators  of  the  ratios.  Bessent,  Bessent,  and  Clark 
suggest  that  ratios  should  be  broken  down  into  their 
physical  input  and  output  components  for  the  Constrained 
Facet  Analysis  evaluation.  The  input/output  measures  could 
be  put  back  into  ratio  form  after  the  Constrained  Facet 
Analysis  so  that  managers  could  use  them  while  interpreting 
Constrained  Facet  Analysis  results. 

Linear  Regression.  The  other  common  mathematical  tool 
used  to  measure  efficiency  in  the  fire  service  is  linear 
regression.  Daniel  Z.  Czamanski,  in  his  book  The  Cost  of 
Preventive  Services  (23)  defined  the  concept  of  productivity 
in  public  service  and  then  developed  a  model  of  the 
relationship  of  fire  losses  and  fire  expenditures  using 
simple  linear  regression.  Czamanski  went  on  to  examine  the 
notions  of  "average"  and  marginal  productivity  as  a  relation 
of  outputs  and  inputs,  and  production  efficiency  as  optimal 
allocation  of  a  resource  (23:29).  He  noted  the  same 
limitations  of  linear  regression  analysis  that  were  pointed 
out  by  Bessent,  Bessent,  and  Clark  (6:2)  in  their  discussion 
comparing  regression  to  Data  Envelopment  Analysis.  A  brief 
discussion  of  Bessent,  Bessent,  and  Clark's  findings 
follows. 

Linear  regression  is  a  single  output,  multiple  input 
way  of  evaluating  the  efficiency  of  an  organization. 
Regression  has  both  positive  and  negative  error  terms  and 


tries  to  fit  an  "average  relationship"  curve  which  estimates 
the  relationships  between  the  multiple  inputs  and  single 
output.  One  major  problem  of  regression  analysis  is  that 
these  "average"  curves  do  not  represent  frontiers  which  by 
definition  are  based  on  extremal  relations.  Bessent, 
Bessent,  and  Clark  (6:2)  note  average  estimates  are 
uninformative  or  misleading  as  frontier  estimations  when 
compared  to  Data  Envelopment  Analysis  results.  In  their 
discussion  comparing  Data  Envelopment  Analysis  to 
regression,  they  noted  three  shortcomings  of  linear 
regresson  analysis: 

1 .  Regression  estimates  often  fail  to  identify  the 
existence  and  degree  of  inefficiency  in 
organizations. 

2.  Multiple  outputs  may  contain  interactions  which  are 
undetected  by  regressions  performed  on  each  output 
separately. 

3.  Regression  estimates  confound  inefficient  and 

efficient  units.  Better  regression  estimates  are 
obtained  using  efficient  units  only.  [6:2] 

The  "average  relationship"  curve  produced  by  regression 
is  not  a  true  efficiency  frontier  for  a  given  set  of 
observations.  An  efficiency  frontier  is  made  up  of  those 
observations  that  are  relatively  efficient  compared  to  other 
observations  with  similar  input/output  mixes.  All  other 
observations  not  on  the  efficiency  frontier  are  relatively 
inefficient;  and  in  fact,  an  inefficient  observation  can 
only  be  on  one  side  of  the  frontier  since  a  frontier 
represents  the  "best"  an  organization  can  be.  The 


residuals,  or  error  terms,  that  make  up  the  regression’s 
"average"  curve  can  take  on  both  positive  and  negative 
values  that  fall  both  above  and  below  the  "average 
relationship"  curve  respectively.  A  true  efficiency 
frontier  does  not  have  observations  on  either  side  of  the 
curve;  therefore,  the  size  and  direction  of  the  linear 
regression’s  residuals,  or  error  terms,  result  in  misleading 
information  about  the  organization. 

One  of  the  main  reasons  why  regression  analysis  will 
not  be  used  as  an  efficiency  model  in  this  study  is  that  it 
cannot  take  into  account  the  relationships  between  multiple 
outputs  and  multiple  inputs.  Analysis  of  fire  departments 
requires  the  capability  to  analyze  relationships  between 
multiple  inputs  and  multiple  outputs,  including  the  effects 
of  the  interactions  between  outputs  competing  for  the -same 
resources  (inputs). 

The  third  shortcoming  of  linear  regression  noted  by 
Bessent,  Bessent,  and  Clark  (6:6)  occurs  when  organizations 
are  operating  under  different  technologies.  Although  two 
organizations  have  the  same  amount  of  inputs,  the 
organization  with  the  highest  level  of  technical  efficiency 
would  have  a  higher  level  of  output.  The  difference  in  the 
expected  output  levels  of  the  two  organizations  would  be 
accounted  for  in  the  regression's  residual  term.  Since  the 
regression  estimates  are  influenced  by  both  efficient  and 
inefficient  observations  simultaneously,  the  resulting 


average  curve  and  regression  equation  could  misrepresent 
both  organizations.  Bessent,  Bessent,  and  Clark  provide  a 
more  detailed  discussion  of  these  shortcomings  in  their 
working  paper  titled,  "Notes  Comparing  DEA  to  Statistical- 
Econometrics  and  Ratio  Analysis"  (6). 

Data  Envelopment  Analysis.  A  short  discussion  on  Data 
Envelopment  Analysis  (DEA)  is  provided  as  the  basis  for  the 
Constrained  Facet  Analysis  (CFA)  model  that  will  be  used  in 
this  thesis.  It  should  be  noted  that  the  first  iteration  of 
the  CFA  linear  programming  model  is  in  fact  DEA,  which 
provides  an  upper  bound  of  efficiency  for  a  unit;  and  the 
second  iteration  of  CFA  provides  a  lower  bound  of  efficiency 
for  those  units  considered  to  be  outliers,  units  that  are 
not  fully  explained  by  other  units  with  similar  input/output 
mixes. 

Data  Envelopment  Analysis  is  a  fractional  programming 
model  developed  by  Charnes,  Cooper,  and  Rhodes  in  1978 
(18,19)  to  measure  the  relative  efficiencies  of  like  units. 
Literature  on  Data  Envelopment  is  limited,  but  Bessent, 
Bessent,  and  Clark  provide  a  comprehensive  summary  on  the 
theory  and  its  development,  the  mathematical  model  used  in 
DEA  and  the  model's  requirements,  and  a  brief  review  of  DEA 
applications  to  date  (7).  The  following  summarizes  their 
views. 

The  major  advantage  of  Data  Envelopment  Analysis  (DEA) 
over  regression  and  ratio  analysis  and  the  reason  why  this 


model  is  preferred  is  that  DEA  provides  a  way  to  take 
multiple  outputs  and  multiple  inputs  into  account 
simultaneously,  including  differences  in  input/output  mixes 
and  tradeoffs  among  factors.  By  doing  so,  it  provides 
information  on  the  interaction  of  the  input  and  output 
measures  ( 7  ) . 

Although  DEA  appears  to  be  an  excellent  alternative  for 
analysis  of  nonprofit  organizations,  it  does  have  some 
limitations.  In  DEA,  organizations  that  are  not  fully 
explained  (or  not  fully  enveloped)  are  sometimes  given 
efficiency  ratings  which  seriously  overestimate  the  actual 
efficiency  (7).  This  occurs  because  weights  or  multiplier 
values  are  assigned  by  the  model  to  each  output  and  input  in 
order  to  maximize  the  efficiency  rating  of  the  decision 
making  unit  being  evaluated.  These  weights  are  not  known 
prior  to  the  evaluation  but,  rather,  they  are  derived  from 
the  empirical  data  used  in  the  ex  post  facto  evaluation 
(34:2.58).  It  became  apparent  that  in  many  situations  it 
would  be  unreasonable  for  an  outlier  unit  to  be  given  so 
high  an  efficiency  rating,  given  the  available  inputs  and 
outputs.  Constrained  Facet  Analysis  addresses  this  problem 
and  provides  more  information  on  this  outlier  unit. 

Constrained  Facet  Analysis 

A  practical  way  to  explain  Constrained  Facet  Analysis 
( CFA )  and  the  outlier  units  is  by  geometric  representation. 
The  CFA  model  first  identifies  an  efficiency  frontier  made 


up  of  organizations  "which  achieve  the  highest  level  of 
output  for  their  given  levels  of  input"  (11:3).  Figure 
4.3  illustrates  the  frontier  concept,  which  is  explained 
below.  The  observed  organizations  A  through  D  form  a 
piecewise  linear  frontier  made  up  of  individual  frontier 
segments  or  facets  AB,  BC  and  CD.  When  all  the  frontier 
facets  are  connected  together,  as  shown  in  Figure  4.3,  a  CFA 
efficiency  frontier,  ZZ',  is  formed.  There  are  two  types  of 
frontier  facets  that  must  be  defined.  The  first  is  the 
"proper"  facet.  A  proper  facet  has  two  actual  units  forming 
the  segment  or  facet,  such  as  segment  BC,  where  the  segment 
has  a  negative  slope.  The  second  type  of  CFA  facet  is 
called  an  "artificial"  facet.  The  facets  DM-j  and  DM2  are 
artificial  facets  because  each  is  formed  by  only  one  actual 
unit,  D  or  A,  and  a  point  which  is  not  an  actual  observed 
input  combination,  M-|  or  M2.  Furthermore,  the  slopes  of 
these  artificial  facets  are  zero  and  undefined  respectively. 

The  CFA  efficiency  rating  can  be  easily  obtained 
geometrically  for  units  that  are  on  the  frontier  and  that 
are  "fully  enveloped."  A  unit  is  considered  fully  enveloped 
if  a  ray  from  the  origin  to  the  observed  unit  crosses  a 
proper  frontier  facet.  In  Figure  4.3  units  E,  F,  and  G  are 
fully  enveloped  by  facets  AB,  BC,  and  CD  respectively. 

The  only  observed  unit  not  fully  enveloped  in  Figure 
4.3  is  unit  H.  A  unit  is  considered  an  outlier  or  not  fully 
enveloped  if  a  ray  from  the  origin  to  the  actual  unit,  H, 
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Figure  4.3  CFA  Frontier  made  of  Efficient  Units 


does  not  cross  a  proper  facet  but,  rather,  crosses  an 
artificial  facet  like  DM-| . 


Now  that  the  general  concepts  of  CFA  have  been 
explained,  a  geometric  interpretation  of  a  single  output/two 
input  situation  for  four  fictitious  fire  departments  will 
follow  (21).  Suppose  the  fire  departments  A,  B,  C,  and  D 
shown  in  Table  4.1  each  produced  the  same  product,  Y,  using 
the  same  two  resources,  X-j  and  X2,  during  some  specified 
time  period.  The  actual  amounts  of  resources  Xi  and  X2  used 
to  produce  Y  and  the  amount  of  product  Y  produced  by  a  fire 
department  are  divided  by  the  value  of  Y  to  scale  the  unit 
observations  to  facilitate  comparison,  and  these  scaled 
values  are  recorded  in  Table  4.2.  The  results  of  this 

• 

scaling  are  then  plotted  on  a  two-dimensional  graph  and  a 
piecewise  linear  frontier  is  established.  The  frontier  is 
created  by  connecting  the  points  nearest  the  origin  with 
line  segments  as  shown  in  Figure  4.4.  In  this  example  there 
is  one  proper  facet  BC,  and  two  artificial  facets  CM-|  and 

bm2. 

TABLE  4.1 

CFA  Data  Set  for  Four  Fire  Departments 


Fire 

Output 

Input 

Input 

Department 

Y 

*1 

*2 

A 

3 

1  5 

21 

B 

5 

20 

20 

C 

1 

5 

2 

D 

2 

1  2 

8 

TABLE  4.2 


CFA  Observations  with  Common  Output  Y/Y 


Fire 

Output 

Input 

Input 

Department 

Y/Y 

X-,  /Y 

x2/y 

A 

1 

5 

7 

B 

1 

4 

4 

C 

1 

5 

2 

D 

1 

6 

4 

The  concepts  of  fully  enveloped  and  not  fully  enveloped 
for  this  example  are  illustrated  in  Figure  4.5.  Since  ray 
OD  crosses  the  frontier  segment  BC,  unit  D  is  considered 
fully  enveloped  by  efficient  units  B  and  C.  Unit  A,  on  the 
other  hand,  is  not  fully  enveloped  and  is  considered  an 
outlier  because  ray  OA  crosses  the  artificial  facet  BM2 
rather  than  a  proper  facet. 

Once  the  observations  are  plotted  and  the  piecewise 
linear  efficiency  frontier  is  formed,  the  CFA  efficiency 
rating  for-  each  unit  can  be  determined.  A  single  efficiency 
measure  can  be  obtained  geometrically  for  units  that  are  on 
the  frontier  and  that  are  fully  enveloped.  For  units  that 
are  considered  outliers  and  are  not  fully  enveloped  a  single 
efficiency  rating  cannot  be  obtained.  However,  a  range  of 
efficiencies  with  an  upper  bound  and  a  lower  bound  can  be 
found.  This  range  gives  managers  some  idea  of  their 


inefficiencies . 


Figure  4.4  CFA  Observations  Plotted  and  the  Piecewise  Linear 
Frontier  (FF')  is  Formed 


Note  1:  Unit  A  is  an  outlier  or  not  fully  enveloped"  unit. 

Unit  A  can  only  be  compared  with  efficient  Unit  B  on  the 
FF"  frontier  but  can  be  compared  to  units  B  and  C  on  the 
FF"  frontier. 


Note  2:  Unit  D  is  "fully  enveloped". 

Unit  D  can  be  compared  with  efficient  units  B  and  C  on  the 
frontier  facet. 


Figure  4.5  CFA  Concepts  of  Fully  Enveloped  and  Not  Fully  Enveloped 


Specifically,  the  efficiency  ratings  for  units  A 
through  D  can  be  determined  geometrically  by  following  these 
four  steps: 

1.  Draw  rays  from  the  origin  to  each  point  A,  B,  C, 
and  D; 

2.  Measure  the  distance  along  each  ray  from  the  origin 
to  the  frontier  it  crosses; 

3.  Measure  the  distance  from  the  origin  to  the 
observed  point;  and 

4.  Calculate  the  efficiency  by  dividing  the  distance 
to  the  frontier  by  the  distance  to  the  point. 

Figure  4.6  and  Table  4.3  illustrate  the  four-step 
efficiency  rating  method,  and  the  following  characteristics 
can  be  noted  from  the  efficiency  rating  results.  Since 
units  B  and  C  are  on  the  frontier,  their  efficiency  ratings 
are  equal  to  1.0,  and  they  are  relatively  efficient  when 
compared  to  units  A  and  D  for  this  example.  Units  A  and  D 
are  not  efficient  relative  to  frontier  facet  BC;  therefore, 
their  efficiency  ratings  are  less  than  1.0. 

Since  observation  D  is  fully  enveloped,  a  single 
efficiency  rating  can  be  obtained  by  taking  13.8 
centimeters,  the  distance  from  the  origin  to  the  proper 
facet,  and  dividing  by  18.4  centimeters,  the  distance  from 
the  origin  to  the  observed  point  D,  for  an  efficiency  rating 
(hDu*)  equal  to  0.75.  Unit  D  was  compared  to  efficient 
units  B  and  C,  which  have  similar  input/output  mixes  as  unit  D 


Fire 

Department 

Distance  to 
Frontier 
(cm) 

Distance  to 
Observed 

Point  ( cm ) 

Eff  ic 

Upper  Bound 

iency 

Lower  Bound 

FF* 

FF" 

A 

B 

15.4 

21.9 

■B 

.703 

B 

1 

- 

14.4 

- 

C 

- 

13.7 

D 

B 

18.4 

.750 

The  upper  bound  efficiency  measure  for  unit  A  is 
achieved  by  comparing  unit  A  to  efficient  unit  B  only.  In 
Figure  4.6,  the  upper  bound  efficiency  rating  for  A  is  found 
by  dividing  the  distance  from  the  origin  to  the  point  U  by 
the  distance  from  the  origin  to  the  observed  unit  A.  As 
shown  in  Table  4.3  the  upper  bound  measure  (hAu*)  is  equal 
to  0.800. 

The  lower  bound  efficiency  measure  is  found  in  a 
similar  manner.  The  difference  is  that  the  lower  bound 
efficiency  for  unit  A  is  measured  relative  to  units  B  and  C 
instead  of  unit  B  alone.  From  Figure  4.6,  the  lower  bound 
rating  (hAL*)  is  obtained  by  dividing  the  distance  from  the 


origin  to  the  point  L  by  the  distance  from  the  origin  to  the 
observed  unit  A.  Results  of  units  A,  B,  C,  and  D  efficiency 
ratings  are  shown  in  Table  4.3. 


A  large  range  between  the  upper  and  lower  bounds  of 
efficiency  implies  that  we  cannot  fully  explain  the 
inefficiency  for  that  particular  unit,  and  that  a  closer 
inspection  of  this  outlier  is  required  before  conclusions 
can  be  drawn  (11:15).  On  the  other  hand,  if  "the 
difference  between  the  upper  and  lower  bound  measures  is 
relatively  small"  (11:15)  for  a  particular  unit,  then  the 
mix  of  inputs  and  outputs  of  that  unit  is  similar  to  the 
units  in  the  nearby  frontier  facet. 

Given  that  a  manager  can  obtain  an  efficiency  rating 
for  the  organization's  ability  in  using  inputs  to  produce 
outputs,  what  can  be  done  to  improve  the  efficiency  of  the 
organization?  Two  frontier  concepts,  marginal  rates  of 
substitution  and  marginal  rates  of  productivity,  can  be 
obtained  from  CFA.  These  rates  provide  valuable 
information  so  managers  can  make  tradeoffs  between  resources 
and  products  or  services  to  improve  the  unit's  efficiency 
rating.  These  marginal  rates  can  be  computed  by  using  input 
and  output  "multiplier"  values  which  will  be  defined  and 
explained  below. 

The  input/output  multipliers  of  the  CFA  model  are  used 
to  adjust  the  observed  values  to  simulate  how  an  inefficient 
organization  can  reallocate  resources  and  alter  current 
services  to  become  a  more  efficient  organization.  The 
multipliers  are  obtained  by  extending  a  frontier  facet  like 
BC  in  Figure  4.7  to  each  axis,  X-j  and  X2 . 


One  set  of 


multipliers  consisting  of  two  multiplier  values,  one  for 
each  axis,  can  be  determined  geometrically  for  each 
efficient  unit  and  fully  enveloped  inefficient  unit.  The 
first  input  multiplier  for  unit  B  is  found  by  extending  the 
BC  facet  until  it  crosses  the  Xi  axis.  The  point  (6,0)  is 
the  point  of  intersection.  The  reciprocal  of  the  X-j  value 
is  the  first  input  multiplier  v1  and  it  equals  1/6.  The 
second  multiplier  V2  for  unit  B  is  obtained  in  a  similar 
manner.  The  intersection  of  the  extended  BC  facet  and  the 
X2  axis  is  the  point  (0,12).  Therefore,  the  input 
multiplier  v2  equals  1/12.  Similarly,  for  inefficient  unit 
D,  which  is  fully  enveloped  by  units  B  and  C,  the 
multipliers  are  obtained  by  extending  a  line  through  point  D 
which  is  parallel  to  the  proper  facet  BC  in  this  case. 

Unlike  the  efficient  units  and  the  inefficient  units 
that  are  fully  enveloped,  outlier  units  like  unit  A  that  are 
not  fully  enveloped  have  two  sets  of  multipliers.  The  first 
set  is  found  by  drawing  a  line  through  A  that  is  parallel 
to  the  X-|  axis  and  the  artificial  frontier  facet  BM2 .  This 
line  intercepts  the  X-j  axis  at  (5,0),  but  does  not  intercept 
the  X2  axis.  Therefore,  the  input  multiplier  for  unit  A 
equals  1.5  and  the  V2  input  multiplier  equals  zero  (1/®). 

The  second  set  of  multiplier  values  is  obtained  by  drawing  a 
line  through  A  parallel  to  the  closest  proper  facet  BC.  The 
multipliers  are  obtained  in  a  similar  fashion.  Figure  4.7 
shows  all  the  intercept  values  for  each  unit,  and  Table  4.4 


summarizes  the  information  from  Figure  4.7  and  the  input 
multipliers  obtained. 


Once  the  multipliers  are  determined,  they  can  be 
manipulated  in  conjunction  with  the  efficiency  (hj*)  to 
obtain  both  the  marginal  rates  of  substitution  and  marginal 
rates  of  productivity  by  using  the  following  formulas: 

Marginal  Rate  of  Substitution 
of  Input  X-| 
for  Input  X2 

Marginal  Rate  of  Productivity 
of  Input  X i 
in  Producing  Y 


Marginal  Rate  of  Productivity 
of  Input  X2 
in  Producing  Y 

"These  rates  are  useful  and  informative  because  they  are 
derived  from  the  nearest  set  of  empirical  observations" 
(11:16).  These  rates  which  might  be  used  in  planning 
productivity  improvements  have  been  calculated  for  the  data 
from  Table  4.4  using  the  above  formulas,  and  the  results  are 
shown  in  Table  4.5. 

The  negative  values  of  the  rates  of  substitution  also 
represent  the  slope  of  the  frontier  facet  to  which  the  unit 
is  compared.  For  example,  unit  D  is  associated  with  facet 
BC  and  the  slope  of  that  facet  is  -2.  From  Table  4.5,  unit 


v2 

vi 


,*  j  =  A,B,C,D 


j  =  A,B,C,D 


D's  value  of  -2.0  indicates  the  marginal  rate  of 
substitution  between  input  X-|  and  input  X2 .  Thus,  if  unit  D 
is  operating  efficiently,  an  increase  of  one  unit  of 
resource  X-j  would  require  a  decrease  of  approximately  1  x 
2.0  =2  units  of  resource  X2 ,  provided  the  output  amount 
remains  constant  (11:16).  The  same  input  relationship  is 
true  of  the  other  inefficient  unit  A. 

The  marginal  rate  of  productivity  values  are  positive 
values  which  represent  the  amount  that  outputs  are 
influenced  by  a  change  in  inputs.  For  example,  if  unit  D's 
resource  X-|  is  increased  by  one  unit,  a  positive  increase  of 
approximately  v-|/hj*  units  of  output  Y  would  be  required  for 
the  unit  to  remain  efficient,  provided  of  course  that  the  X2 
amount  remains  the  same. 

As  mentioned  previously,  managers  of  inefficient  units 
would  like  to  know  which  changes  in  resources  (inputs)  or 
products/ services  (outputs)  would  lead  to  an  efficient 
rating.  As  noted  by  Clark  (21)  there  are  an  infinite 
number  of  alternative  input/output  combinations  which  an 
inefficient  unit  could  adopt  to  achieve  the  frontier  of 
relative  efficiency.  These  alternatives  can  be  obtained 
from  the  optimal  solutions  of  Constrained  Facet  Analysis. 

For  more  details  in  this  area  see  Appendix  D. 

CFA  can  be  explained  mathematically  as  well  as 
geometrically.  For  those  readers  who  are  interested  in  the 
mathematical  interpretation  of  CFA,  the  same  single  output 


two  input  example  illustrated  geometrically  above  is  also 
presented  mathematically  in  Appendix  D.  The  CFA  primal  and 
dual  linear  programming  models  that  are  used  in  mathematical 
illustration  are  found  in  Appendix  E. 

Although  CFA  was  explained  here  for  a  simple  single 
output  two  input  situation  in  two  dimensions,  CFA  can  also 
be  used  for  multiple  input  and  multiple  output  situations 
where  the  geometric  interpretation  would  be  multi¬ 
dimensional  and  impossible  to  represent  graphically. 

However,  the  mathematical  program  can  be  solved  by  computer 
and  CFA  results  can  be  obtained  for  use  by  managers  even  in 
multiple  input,  multiple  output  situations.  The  Constrained 
Facet  Analysis  code  is  currently  on  the  TAURUS  CDC  Cyber 
170/750  mainframe  computer  at  the  University  of  Texas. 

Of  the  mathematical  models  reviewed  thus  far,  only 
Constrained  Facet  Analysis  can  distinguish  between 
relatively  efficient  units  and  inefficient  units  for  non¬ 
profit  organizations  with  multiple  inputs  and  multiple 
outputs.  CFA  is  also  the  only  mathematical  model  reviewed 
that  considers  all  input/output  measures  simultaneously 
while  providing  multipliers  (weights)  for  each  input  and 
output  which  are  derived  empirically. 

With  the  completion  of  this  comparison  of  mathematical 
models,  it  has  been  shown  that  the  Constrained  Facet 
Analysis  model  apparently  does  provide  the  best  method  of 
analyzing  the  data. 


The  collection  of  data  for  this  research  was 
accomplished  using  the  data  information  form  shown  in  Figure 
5.1.  Accompanying  the  data  form  were  attachments  containing 
instructions  for  form  completion.  The  complete  data 
information  package  is  contained  in  Appendix  F.  Most  of  the 
instructions  were  specified  by  referring  to  AF  Form  1528, 

Fire  Protection  Activity  Report  (Figure  4.2),  and  AF  Form 
278,  Fire  Incident  Report.  Some  data  required  more 
extensive  instructions  for  using  Base  Engineer  Automated 
Management  System  (BEAMS)  retrieval  or  budgeting  reports, 
and  these  instructions  were  developed  with  the  assistance  of 
Ms  Alice  Anderson  (2)  a  Management  Analyst  at  Wright- 
Pat  terson  AFB  Ohio. 

* 

When  the  instructions  were  complete,  the  data 
inf orm  ition  package  was  reviewed  for  accuracy,  completeness, 
and  data  availability  by  the  following  persons: 

Major  Philip  M.  Ray 

Readiness  Team  Chief  AFESC/DEF  Tyndall  AFB  FL 

Chief  Master  Sergeant  Bryce  E.  Mason 

Fire  Protection  Manager  AFESC/DEF  Tyndall  AFB  FL 

Chief  Master  Sergeant  Guy  J.  Wills,  Jr. 

Acting  Fire  Chief  3202  CES/DEF  Eglin  AFB  FL 

Master  Sergeant  Joe  Ybarra 

Fire  Protection  Supervisor 

HQ  AFSC/DEMF  Andrews  AFB  MD 


After  final  approval,  a  cover  letter  recommending  support 


of  the  effort  was  provided  by  Colonel  George  R.  Tate, 
Director  of  Operations  and  Maintenance  AFESC/DEM.  The  cover 
letter  and  request  for  information  in  Appendix  F  were  sent 
from  AFESC/DEM  to  all  CONUS  Air  Force  Fire  Departments 
through  their  respective  major  commands.  Data  to  be 
collected  were  for  fiscal  year  1983. 

Data  Collection  Response.  Seventy  out  of  eighty-one 
active  duty  base  fire  departments  and  seven  base  fire 
departments  operated  by  Air  Force  Reserves  responded  in  the 
appropriate  time  period,  and  their  data  were  subjected  to  an 
initial  screening.  Of  those  respondents,  the  seven  Air 
Force  Reserve  operated  fire  departments  were  excluded  from 
the  data  set  becausfe  the  authors  felt  their  operations  "were 
not  comparable  to  active  duty  f$re  department  operations. 
Another  seven  data  sets  were  not  used  because  data  were 
missing  or  because  questionable  data  could  not  be  confirmed 
by  telephone.  This  left  63  bases  with  data  sets  appropriate 
for  Constrained  Facet  Analysis  use. 

Cleansing  the  Data 

Within  the  63  data  sets  several  data  items  were 
omitted  or  "cleansed"  and  several  assumptions  were  made. 

The  data  information  form  in  Figure  5.1  requested  107  data 
items.  Of  those,  eight  items  were  demographic  information 
and  points  of  contact  for  data  confirmation  and  were  not 
needed  for  CFA  analysis. 


A  majority  of  respondents  failed  to  report  the 
"manhours"  of  the  fire  department  outputs  in  items  (9) 
through  item  (40)  in  Figure  5.1.  Therefore,  the  authors 
did  not  use  "manhours"  but  rather  the  actual  "number"  of 
outputs  requested  on  the  form. 

The  input  items  (64)  through  item  (73)  on  the  data 
information  form  requested  "total"  and  "total  available" 
manhours  for  each  fire  department  branch.  Several  bases  did 
not  provide  "total,"  and  others  provided  "total"  while  also 
responding  to  "total  available."  In  the  latter  case,  the 
number  of  personnel  was  usually  given  instead  of  manhours. 
The  manhour  data  reported  most  frequently  was  "total 
available"  manhours.  For  those  bases  providing  "total 
available"  by  number  of  personnel  the  following  assumptions 
and  calculations  were  made:  $ 

1)  Management,  Technical  Services,  and  clerical 
employees  work  a  40-hour  week. 

2)  Operations  personnel  work  a  7 2 -hour  week. 

3)  All  personnel  work  48  weeks  per  fiscal  year. 

4)  Item  (65)  "Total  available  Fire  Department 
manhours"  =  (Total  Fire  department  -  Operations 
-  Technical  Services)  x  40  hours  per  week 

x  48  weeks  per  year  -t-  item  (67)  +  item  (69) 

5)  Item  (67)  "Total  available  Operation  manhours" 

*  #  Operations  personnel  x  72  hours  per  week 

x  48  weeks  per  year 

6)  Item  (69)  "Total  available  Technical  Services 
manhours"  =  §  Technical  Services  personnel 

x  40  hours  per  week  x  48  weeks  per  year 


Another  variable  omitted  was  item  (86)  "Industrial 
Structure  Value  at  Risk  ($)"  because  respondents  interpreted 
the  term  "industrial"  differently.  The  authors  interpreted 
industrial  structures  as  any  building  other  than  housing 
units.  Item  (86)  was  considered  to  be  extraneous  because 
item  (34)  "Real  Property  Value  at  Risk  ($)"  is  available. 

To  get  the  data  requested  in  item  (86)  a  simple  mathematical 
subtraction  operation  is  needed. 

Also,  in  item  (74)  through  item  (83),  the  authors 
distinguished  between  "total"  and  "total  available" 
personnel  in  various  skill  levels.  Most  responses  had  the 
same  value  in  each.  The  authors  confirmed  by  telephone  that 
data  for  "total  available"  personnel  was  more  accurate,  and 
the  "total"  skill  level  items  were  deleted. 

Other  assumptions  pertaining  to  the  original  data  form 
include: 

1)  For  item  (63),  "Contracted  Services"  expenditures, 
some  bases  did  not  provide  a  value,  but  did  provide  all 
other  requested  expenditure  information.  If  this  was  the 
case,  the  authors  assumed  there  were  no  contracted  services 
and  entered  a  value  of  zero  for  that  response. 

2)  For  "#  Vehicle  Available  Hours"  in  items  (93) 
through  item  (104),  a  100%  availability  rate  was  assumed  if 
no  response  was  given. 

3)  For  item  (105),  "Aircraft  Value  at  Risk,"  a  zero 
was  assumed  whenever  values  were  not  reported. 


This  left  the  30  input  and  42  output  measures  shown  in 
Table  5.1  acceptable  for  editing,  reconfiguring,  and  coding 
into  the  Constrained  Facet  Analysis  format. 


TABLE  5.1 

Input/Output  Data  Set  #1 


INPUTS  OUTPUTS 


11 

Total  #  inspectors 

01 

§  Aerospace  vehicle 

12 

Civilian  pay  ($) 

02 

Total  #  fire  responses 

13 

Military  pay  ($) 

03 

#  Housing  fire  responses 

14 

Supply  ($) 

04 

ft 1  Other  fire  responses 

15 

Equipment  ( $ ) 

05 

#  Fuel  spill  responses 

16 

Contracted  services  ($) 

06 

#  Mutual  aid  responses 

17 

Total  available  Fire  Dept 
manhours 

07 

#  Other  responses 

18 

Total  available  Operations 
Branch  manhours 

08 

§  Aircraft,  standbys 

19 

Total*  available  Technical 
Services  Branch  manhours 

09 

#  Other  standbys 

no 

Total  available  civilian 
manhours 

01  0 

H  Aircraft  rescue 
drills 

11 1 

Total  available  military 
manhours 

01 1 

H  Structural  drills 

112 

#  Personnel  in 

Skill  level  57190 

01  2 

H  Classroom  Training 
sessions 

11  3 

ff  Personnel  in 

Skill  level  57170 

013 

it  Prime  BEEF  Training 
sessions 

114 

#  Personnel  in 

Skill  level  57150 

01  4 

#  Documents  reviewed 

115 

#  Personnel  in 

Skill  level  57130  -  57110 

015 

§  In-service  Documents 
reviewed 

116 

H  Personnel  in 

Skill  level  57100 

016 

H  Contract  Documents 
reviewed 

117 

Equipment  value  ($) 

017 

Housing  fire  loss  ($) 

118 

Fire  Dept  facility  value  {$) 

018 

Other  fire  loss  ($) 

11  9 

Total  #  vehicles 

019 

Total  fire  loss  ($) 

120 

Value  of  119 

020 

Housing  loss  per 
reportable  fire  ($) 

121 

Available  hours  of  119 

021 

Other  loss  per 
reportable  fire  ($) 

TABLE  5.1  Continued 


INPUTS 


OUTPUTS 


122  if  Crash/firefighting 

vehicles 

123  Value  of  122  ($) 

124  Available  hours  of  122 

125  H  Structural  pumpers 

126  Value  of  125  ($) 

127  Available  hours  of  125 

128  if  Other  vehicles 

129  Value  of  128  ($) 

130  Available  hours  of  128 


022  Total  loss  per 

reportable  fire  ($) 
023  #  Housing  inspections 
024  §  Other  inspections 
025  Total  #  inspections 
026  Base  populace  fire 
deaths 

027  Firefighters  deaths 
028  Base  populace  fire 
injury 

029  Firefighters  injury 
030  if  Presentations 
on-base 

031  #  Presentations 
off-base 

032  #  Landings  &  takeoffs 
033  Land  area  (acres) 

034  Real  property  value 
035  Housing  value  at  risk 
036  Effective  base  pop 
037  H  Active  runways 
038  if  Housing  units 
039  #  Fire  stations 
040  Aircraft  value  at 
risk  ($) 

042  Aircraft  loss  ($) 


NOTE:  Henceforth,  all  references  to  data  elements  will  be 
by  the  input/output  numbers  contained  in  this  table. 


Preliminary  Data  Analysis 

The  preliminary  data  analysis  includes  the  steps  of 
editing  and  coding  the  data  collected.  Both  of  these  two 
steps  are  discussed  below. 
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Editing  the  Data.  The  first  step  in  editing  was  to 
insure  the  input/output  set  fulfilled  the  conceptual  belief 
that  a  change  in  output  should  be  caused  by  a  change  in  the 
inputs.  This  is  called  an  "isotonic"  relationship.  For 
example,  if  an  oganization  is  efficient  an  increase  in 
inputs  results  in  an  increase  in  outputs,  and  a  decrease  in 
inputs  should  cause  a  decrease  in  outputs. 

Reciprocal  values  were  used  for  the  output  candidates 
in  Table  5.2  to  insure  the  existence  of  an  isotonic 
relationship  between  the  inputs  and  those  outputs. 


TABLE  5.2 

Variables  with  Reciprocal  Values 


1)  Measures  that  have  values  of  1,000,000  or  more  will 

create  an  overflow  accompanied  by  the  error  message 
"illegal  data  in  record  number  <x>."  Thus,  if  any 
output  or  input  measure  that  contains  a  value  of 
1,000,000  or  more,  the  measures  for  all  organizations 
must  be  scaled  by  some  power  of  10  so  that  all  values 
of  the  output  or  input  are  less  than  1,000,000.  [13:6] 

2)  The  user  otherwise  should  not  be  concerned  about 
ill  conditioned  data  or  data  elements  with  observed 
zero  values.  Since  solutions  are  invariant  to  scale, 
an  automatic  scale  and  descale  routine  has  been 
incorporated  in  the  CFA  code  for  user  convenience  and 
computational  ease.  [13:6] 

Coding  the  Data.  After  the  appropriate  data  items  were 
scaled,  a  nine  digit  organizational  code  unit  identifier  was 
given  to  each  base  to  demographically  separate  the  bases  and 
to  identify  the  bases  by  MAJCOM.  An  example  of  the  unit 
identifier  code  is  illustrated  below. 
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The  appropriate  codes  are  found  in  Appendix  F  as  part  of  the 
data  collection  instruction  form. 

The  data  was  then  keypunched  on  cards  at  the  Air  Force 
Institute  of  Technology  Computer  Center  using  the  CFA  format 
(13)  described  below.  Cards  1  thru  14  were  for  the  complete 
data  set,  followed  by  63  sets  of  12  cards  for  each  Fire 
Department  (Decision  Making  Unit). 


CARD 


DESCRIPTION 


FORMAT 


#1  "Problem  Title" 


12X,13A6,A2 


#2  "Number  of  Organizational  Units", 

"Number  of  Outputs", 

"Number  of  Inputs" 

Card  "Output  1  Label", 

Group  "Output  2  Label",  ... 

#3  -  #13  "Output  42  Label", 

"Input  1  Label", 

"Input  2  Label",  ... 

"Input  30  Label" 

#14  Blank  Card 


Card 

Group 

Set 

for 

each 

Fire 

Dept. 


Identifier  Record:  "9  digit 
Organizational  Unit  Identifier", 
"Name  of  Fire  Department" 

Data  Records:  "9  digit 
Organizational  Unit  Identifier", 
Output  measures  for  the 
Fire  department  followed  by 
Input  measures  for  the 
Fire  Department 


1  2X ,  315 


1 2X , 7A1 0 


2X, A1 0 , 6A1 0 , A8 


2X , A1 0 , 7F8 . 0 


The  complete  data  set  found  in  Appendix  G  is  shown  in  the 
Constrained  Facet  Analysis  format,  which  enables  the 
analysis  to  be  executed. 

Reduction  of  Input/Output  Candidate  List 

At  this  point  in  the  research  process,  the  data  on  the 
input/output  candidates  is  available  and  has  been  edited  and 
coded  for  the  Constrained  Facet  Analysis  efficiency  model. 


Reduction  of  the  data  is  now  required  to  conform  to  the 
limitations  of  the  Constrained  Facet  Analysis  code. 

If  "n"  is  the  total  number  of  Decision  Making  Units 
( DMUs )  or  Fire  Departments,  then  as  a  rule  of  thumb  the  CFA 
code  will  provide  meaningful  results  if  no  more  than  n/2 
input  and  output  measures  are  used  in  the  analysis.  The 
initial  list  of  candidate  measures  consisted  of  63  DMUs 
with  72  input/output  measures.  According  to  the  rule  of 
thumb,  the  maximum  number  of  input/output  measures  should  be 
about  31.  Several  of  the  candidates  represented  the  same 
fire  department  characteristic  and  could  be  used 
interchangeably.  It  was  planned  to  interchange  variables 
representing  similar  characteristics  to  determine  which  of 
these  variables  would  best  represent  fire  department 
objectives  and  operations. 

This  would  also  reduce  the  number  of  input /output 
variables  to  a  manageable  number  that  could  consistantly  be 
used  in  CFA  in  future  analysis.  A  smaller  number  of 
input/output  variables  is  preferred  because  analysis  using  a 
larger  number  is  harder  to  interpret. 

Reduction  of  Variables 

The  Constrained  Facet  Analysis  code  is  currently  on  the 
TAURUS  CDC  Dual  Cyber  170/75C  mainframe  computer  at  the 
University  of  Texas  at  Austin.  It  was  necessary  to  go  to 
University  of  Texas  to  learn  the  CFA  software  and  to  analyze 
the  data.  Drs .  A.  Bessent,  W.  Bessent,  and  T.  Clark  (10) 


sponsored  a  Productivity  Assessment  Symposium  at  the 
University  of  Texas  June  25  through  29,  1984.  The  symposium 
included  discussion  on  CFA  methodology  with  participants  to 
update  their  understanding  of  productivity  assessment 
techniques.  The  participants  in  the  Productivity  Assessment 
Symposium  are  shown  in  Appendix  H. 

The  data  set  in  Appendix  G,  consisting  of  63  DMUs  and 
30  inputs  and  42  outputs,  was  read  into  the  Cyber.  There 
were  no  problems  with  the  data  format.  However,  the  authors 
were  informed  by  Drs.  A.  Bessent  and  W.  Bessent  (10), 
supporters  of  the  research  and  maintenance  of  the  CFA  code, 
that  the  code  was  currently  dimensioned  to  handle  no  more 
than  a  total  of  20  input/output  measures  per  fire 
department.  Dr.  Authella  Bessent  tried  to  redimension  the 
CFA  code  to  analyze  up  to  1 00  inputs  and  outputs  at  one 
time,  but  her  efforts  were  unsuccessful.  Due  to  the 
inability  to  redimension  the  code,  this  research  effort  was 
affected  as  follows: 

1 )  The  authors  were  forced  to  reduce  the  data  to  more 
general  categories. 

2)  A  detailed  analysis  of  subsets  of  measures  could 
not  be  performed,  for  example  ...  Housing  vs  Total. 

3)  The  simultaneous  interaction  of  all  fire  department 
input  and  output  measures  could  not  be  evaluated. 


4)  Recommendations  to  managers  cannot  be  as  detailed 
using  general  input  and  output  measures;  however,  general 
recommendations  for  organizational  improvements  can  be  made 
and  areas  that  require  management  to  look  at  in  more  detail 
can  be  addressed. 

The  20  input/output  limitation  was  unforeseen; 
therefore,  it  became  even  more  important  to  statistically 
reduce  the  total  number  of  variables.  The  authors  were 
faced  with  reducing  the  original  72  variables  to  20  or  less 
prior  to  CFA  analysis,  while  still  capturing  Fire 
Department  characteristics  either  directly  or  indirectly. 

To  aid  in  this  reduction  procedure,  the  Statistical 
Package  of  Social  Sciences  (SPSS)  and  its  PEARSON 
CORRELATION  subroutine  was  used.  The  authors  analyzed 
outputs  versus  outputs,  inputs  versus  "inputs,  and  outputs 
versus  inputs  to  determine  the  correlation  between  all  72 
variables  in  Table  5.1. 

In  determining  the  strength  of  the  relationship  between 
variables,  the  PEARSON  CORRELATION  coefficient  measures  how 
well  the  value  of  one  variable  can  be  described  on  the  basis 
of  a  knowledge  of  another  variable.  Therefore,  the 
correlation  coefficient  measures  the  strength  of  correlation 
between  two  variables.  Values  close  to  zero  indicate  a  weak 
relation;  values  close  to  +1 .0  indicate  a  strong  "positive" 
correlation;  and  values  close  to  -1 .0  indicate  a  strong 
"negative"  correlation. 


The  following  criteria  for  variable  reduction  were 
considered  in  using  the  PEARSON  CORRELATION  values: 

1 )  If  a  high  positive  correlation  exists  between  any 
two  input  variables  or  any  two  output  variables,  then  one  of 
the  factors  is  sufficient  to  measure  the  activity  and  the 
other  can  be  discarded. 

2)  If  a  low  correlation  exists  between  an  input 
variable  and  all  output  variables,  then  there  is  a  weak 
relation  between  the  variables;  therefore,  if  the 
correlation  values  were  close  to  zero  the  input  variable  was 
omitted  from  the  analysis. 

3)  If  a  negative  correlation  between  inputs  and 
outputs  exists,  then  the  variable  causing  the  negative 
correlation  was  omitted.  Such  negative  correlations  were 
interpreted  to  mean  that  additional  amounts  of  the  inputs 
tend  to  reduce  outputs,  a  condition  which  violates  the 
isotone  property  discussed  on  page  66. 

Reduction  #1 .  The  initial  PEARSON  CORRELATION  analysis 
resulted  in  changes  to  the  data  set.  To  reduce  the 
variables,  the  authors  1)  used  data  representing  total 
quantities  instead  of  their  subsets;  2)  combined  like  data, 
referred  to  as  "collapsing"  data;  and  3)  statistically 
reviewed  the  data  again  using  Pearson  Correlations  to 
identify  other  possible  reductions. 


First,  the  authors  used  the  total  quantity  values  of  a 


measure  rather  than  its  subset  values.  This  decision 
reduces  the  detailed  analysis  the  authors  had  hoped  to 
provide  managers.  For  example,  "total  building  responses 
(02)"  was  used  instead  of  the  subgroups  of  "housing  building 
responses  (03)"  and  "other  building  responses  (04)".  The 
complete  list  of  variables  using  the  total  quantity  measures 
is  shown  in  Table  5.3. 


TABLE  5.3 

Variables  using  Total  Quantity  Measures 


VARIABLE  USED 


022  Total  Loss  per 

Reportable  Fire  ( $ ) 


VARIABLES  DELETED  FROM  DATA  SET 


02  Building  Fire  Responses 
019  Building  Fire  Loss  ($) 


03  Housing  Fire  Responses  & 
04  Other  Fire  Responses 


017  Housing  Fire  Loss  ($)  & 
018  Other  Fire  Loss  ($) 


020  Housing  Loss/Fire  ($)  & 
021  Other  Loss/Fire  ($) 


025  Total  #  Inspections 


023  §  Housing  Inspections  & 
024  #  Other  Inspections 


value  at  risk  (035)"  will  also  be  deleted  from  the  variable 
list.  Both  of  the  above  measures  were  surrogate  measures 
for  amount  of  protection  provided  to  base  housing  units. 


Second,  the  authors  combined  data  representing  similar 
fire  department  activities.  For  example,  all  fire 
department  responses  were  combined  or  collapsed.  Table  5.4 
shows  all  the  data  collapsed  to  form  one  variable  and  the 
variables  deleted  from  the  data  set. 

At  this  point,  the  authors  also  subjectively  omitted 
the  "vehicle  available  hours  (121),  (124),  (127)  and  (130)" 
from  the  data  set.  The  authors  had  several  none  responses 
in  these  variables  and  had  assumed  100%  availability  when 
the  data  were  omitted.  With  this  in  mind,  the  accuracy  of 
this  data  was  questionable  and  therefore  deleted  from  the 
data  set. 


TABLE  5.4 

Variables  Collapsed 


NEW  VARIABLE 


VARIABLES  COLLAPSED  AND  DELETED 


043  Responses 
044  Standbys 
045  Drills 

046  Documents  Reviewed 
047  Presentations 
131  Expenditures 


=01  +02+05+07 
=08+09 
=  010  +  011 
=  014  +015  +016 
=  030  +  031 
=14+15+16 


1)  "Mutual  aid  responses  (06)"  was  deleted  because  data 
did  not  represent  all  fire  department  mutual  aid  responses. 
The  responses  recorded  at  base  level  consisted  of  only 
responses  to  community  fire  departments.  The  reverse  was 
not  recorded. 

2)  The  "number  of  active  runways  (037)"  was  omitted 
because  the  authors  felt  the  "total  ff  of  landings  and 
takeoffs  (033)"  was  ar  adequate  surrogate  measure  for 
aircraft  at  risk. 

3)  "Aircraft  value  at  risk  $  (040)"  was  deleted  because 
in  most  cases,  the  data  was  questionable  or  not  present  and 
could  not  be  confirmed. 

4)  "Aircraft  loss  (042)"  was  omitted  since  the  "number 
of  aircraft  incidents  (041 )"  was  deemed  an  adequate 
surrogate  measure  of  aircraft  loss  and  the  data  was  more 
dependable. 

5)  "Loss  per  reportable  fire  (022)"  was  not  used 
because  it  was  highly  correlated  with  "total  fire  loss 
(043)".  Also,  the  authors  believed  "total  fire  loss"  best 
represents  how  effective  the  fire  department  is  once  a  fire 
is  responded  to. 

6)  "Total  #  inspectors  (II)"  was  deleted  because 
"Technical  Services  manhours"  also  evaluates  the  use  of 
personnel  in  the  Technical  Services  Branch  of  the  fire 
department. 


7)  "Fire  related  deaths  to  firefighters  (027)"  was 
omitted  because  the  PEARSON  CORRELATION  reflected  the  data 
did  not  affect  fire  department  productivity.  After  a  review 
of  all  data  sets,  it  was  found  that  all  values  were  equal  to 
zero. 

These  omissions  reduced  the  data  set  from  72 
input/output  variables  to  40  variables  consisting  of  23 
inputs  and  17  outputs.  The  reduced  input/output  list  is 
shown  in  Table  5.5. 

Reduction  § 2 .  The  authors  recombined  variables  again 
in  an  attempt  to  reduce  the  variables  to  an  acceptable 
number.  Considering  the  correlation  values,  an  attempt  to 
generalize  categories  representing  similar  fire  department 
tasks  was  performed.  The  broader  variables  formed  to 
directly  or  indirectly  capture  Fire  Department  activities 
are  shown  in  Table  5.6. 

The  authors  decided  to  use  only  "total  number  of 
vehicles  (119)"  rather  than  dollar  value  of  vehicles.  Also, 
since  the  authors  omitted  variables  that  were  breakdowns  of 
total  quantities,  like  housing  and  other  structures,  and 
used  the  total  quantities  instead,  the  same  will  be  done 
with  the  vehicle  breakdowns  to  maintain  consistency.  This 
decision  omitted  the  variables  in  Table  5.7. 

Although  this  reduction  exceeds  the  20  variable  limit 
imposed  by  the  CFA  code,  the  authors  settled  on  the  26 
variables  in  Table  5.8  as  the  revised  data  set  to  input  into 


TABLE  5.5 

Input/Output  Data  Set  #2 


12 

Civilian  pay  ($) 

043 

Responses 

13 

Military  pay  ($) 

044 

Standbys 

17 

Total  available  Fire  Dept 
manhours 

045 

Drills 

18 

Total  available  Operations 
Branch  manhours 

012 

#  Classroom 
sessions 

Training 

19 

Total  available  Technical 

01  3 

#  Prime  BEEF 

Training 

Services  Branch  manhours 

110  Total  available  civilian 

manhours 

111  Total  available  military 

manhours 

112  #  Personnel  in 

Skill  level  57190 
113#  Personnel  in 

Skill  level  57170 

114  #  Personnel  in 

Skill  level  57150 

115  #  Personnel  in 

Skill  level  57130  -  57110 

116  #  Personnel  in 

Skill  level  57100 

117  Equipment  value  ($) 

118  Fire  Dept  facility  value  ($) 

119  Total  #  vehicles 

120  Value  of  119 

122  #  Crash/firefighting 

vehicles 

123  Value  of  122 

125  #  Structural  pumpers 

126  Value  of  125 

128  #  Other  vehicles 

129  Value  of  128 


sessions 

019  Total  fire  loss  ($) 

025  Total  #  Inspections 

026  Base  populace  fire 
deaths 

028  Base  populace  fire 
injury 

029  Firefighters  injury 
on-base 

047  Presentations 

032  #  Landings  &  takeoffs 

034  Real  property  value 

036  Effective  base 
populace 

039  #  Fire  stations 

041  #  Aircraft  incidents 


048  Drills/Training 
049  Deaths/Injuries 
050  Documents/Presentations 
132  Skill  level  Upper  Mgmt. 


TABLE  5.7 


=  045  +  012  +  013 

=  026  +  028  +  029 

=  046  +  047 

=  112  +  113  +  116 


Vehicle  Measures  Deleted  from  the  Data  Set 


120  Value  of  total  Fire  Department  vehicles 


122  #  Crash/Firefighter  vehicles 
125  #  Structural  pumpers 
128  #  Other  vehicles 


TABLE  5.8 


Final  Data  Set  Read  into  CFA  Program 


12  Civilian  pay  ($) 

13  Military  pay  ($) 

131  Supplies/Equipment  ($) 

17  Total  available  Fire  Dept 

manhours 

18  Total  available  Operation 

Branch  manhours 

19  Total  available  Technical 

Services  Branch  manhours 

110  Total  available  civilian 

manhours 

111  Total  available  military 

manhours 

132  High  skill  level  manhours 

114  Mid  skill  level  manhours 

115  Low  skill  level  manhours 

117  Equipment  value  ($) 

118  Fire  Dept  facility  value  ($) 

119  Total  §  vehicles 


043  Responses 
044  Standbys 
048  Training/Drills 
050  §  Documents  and 
presentations 
019  Total  fire  loss  ($) 

049  Hurts  (#  deaths  and 
injuries ) 

025  Total  #  inspections 

034  Real  property  at 
risk  ($) 

032  §  Landings  &  takeoffs 
036  Effective  base  pop 
039  #  Fire  stations 
041  §  Aircraft  incidents 


the  CFA  program.  Since  the  user  of  CFA  can  specify  which 
inputs  and  outputs  to  be  considered,  and  the  CFA  program 
read  up  to  30  variables  (10),  the  data  set  in  Appendix  I 
consisting  of  the  26  variables  in  Table  5.8  was  input  into 
the  CFA  program. 

The  authors  planned  to  interchange  outputs  and  inputs 
to  determine  which  measures  provided  the  best  results; 
however,  another  problem  developed.  Computer  time  and  money 
provided  by  Drs.  A.  Bessent  and  W.  Bessent  at  the  Uriversity 
of  Texas  were  limited;  therefore,  the  authors  iould  attempt 
only  seven  combinations  of  variables.  To  determine  which 
variables  to  use,  the  authors  attempted  one  final  PEARSON 
CORRELATION. 

Final  Reduction.  One  final  PEARSON  CORRELATION  was 
made  in  an  attempt  to  reduce  the  number  of  variables 
acceptable  to  the  CFA  code.  Variables  reflecting  a  negative 
correlation  between  inputs  and  outputs  were  omitted. 

The  variables  falling  into  the  first  category  are 
listed  below: 

019  Building  Fire  Loss  ($) 

041  #  Aircraft  Incidents 

049  Hurts  (#  deaths  and  injuries) 

The  variables  falling  into  the  second  category  include: 

050  #  Documents/Presentations 

117  Value  of  Equipment  ($) 

118  Value  of  Fire  Department  Facilities  ($) 


Noting  these  exemptions,  the  variables  remaining  are 


listed  in  Table  5.9.  The  authors  attempted  seven  test 
combinations  of  variables.  To  be  consistent  and  to  provide  a 
basis  of  comparison,  all  eight  output  variables  in  Table  5.9 
were  used  for  each  run.  A  breakdown  of  which  inputs  were 
used  for  each  run  with  the  eight  outputs  will  be  discussed 
in  Chapter  VI. 


TABLE  5.9 

Variables  Selected  for  CFA  Analysis 


INPUTS 

OUTPUTS 

12 

Civilian  pay  ($) 

04*3 

Responses 

13 

Military  pay  ($) 

044 

Standbys 

131 

Supplies /Equipment-  ($) 

048 

Training/Drills  *• 

17 

Total  available  Fire  Dept 
manhours 

025 

Total  §  inspections 

18 

Total  available  Operation 
Branch  manhours 

032 

§  Landings  &  takeoffs 

19 

Total  available  Technical 
Services  Branch  manhours 

034 

Real  property  at 
risk  ($) 

no 

Total  available  civilian 
manhours 

036 

Effective  base  pop 

11 1 

132 
114 
11  5 
11  9 

Total  available  military 
manhours 

High  skill  level  manhours 

Mid  skill  level  manhours 

Low  skill  level  manhours 
Total  §  vehicles 

039 

#  Fire  stations 
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I .  Results  and  Analysis 


This  chapter  will  review  the  Constrained  Facet  Analysis 
( CFA )  program  execution,  discuss  the  seven  test  runs 
analyzed  by  CFA  and  the  problems  encountered  with  each  run, 
summarize  the  CFA  errors  encountered,  and  analyze  the 
printouts  and  reports  generated  by  CFA. 

CFA  Program  Execution 

Prior  to  discussing  the  results  of  each  run  attempted, 
a  discussion  of  the  executive  commands  for  the  code  will  be 
presented.  After  entry  of  the  execution  command,  the  code 
instructs  the  user  to  specify  requirements  of  the  analysis 
from  five  options. 

First,  the  code  asks  which  organizations  are  to  be 
included  in  the  reference  set.  The  reference  set  is  the  set 
of  Decision  Making  Units  (DMUs)  against  which  the  units 
processed  (specified  in  option  2)  will  be  compared  and 
analyzed  for  efficiency  ratings.  The  authors  requested  all 
organizations  be  included  in  each  test  run. 

Second,  the  code  asks  which  DMUs  of  the  reference  set 
are  to  be  processed.  That  is,  which  organizations  does  the 
user  want  analyzed  and  compared  against  the  reference  set. 
Again,  the  authors  specified  all  organizations  be  processed. 
The  user  could  analyze  only  one  unit,  or  just  a  few,  or  all 


units . 


The  next  two  options  ask  which  outputs  and  which 
inputs,  respectively,  are  to  be  included  in  the  analysis. 

The  managerial  reports  available  through  the  CFA  code  are 
the  summary  file,  lambda  file,  and  output  file.  Each  are 
discussed  later  in  this  chapter.  After  the  five  options  are 
specified,  the  program  executes. 

Multiple  Input  Multiple  Output  Tests  Analyzed 

The  authors  attempted  seven  separate  runs  using  seven 
different  combinations  of  inputs  and  outputs.  Each  run  was 
a  multiple  input,  multiple  output  model  and  each  included 
the  eight  outputs  listed  in  Table  5.9.  Table  6.1  lists  the 
input  combinations  used  in  each  of  the  seven  runs. 

CFA  Test  Results 

This  section  addresses  the  results  and  analysis  of 
seven  test  runs  (Tests  1  through  7)  using  the  eight  outputs 
in  Table  5.9  and  the  different  combinations  of  inputs  in 
Table  6.1.  For  each  test,  the  problems  encountered  and  the 
limitations  of  the  CFA  code  will  be  discussed.  Of  the  seven 
tests  only  three  were  successfully  completed  (Tests  1,  4, 
and  5)  while  the  other  four  produced  errors  that  made  the 
runs  unsuccessful. 

Test  1  Analysis.  Test  1  evaluated  eight  outputs  and 
five  inputs.  The  five  inputs  included: 


1 )  Supplies/Equipment 

2)  Vehicles 

3)  High  Skill  Level 


131 

Supplies /Equipment 

131 

Supplies /Equipment 

11  9 

Vehicles 

119 

Vehicles 

132 

High  Skill  Level 

12 

Civilian  Pay 

11  4 
115 

Mid  Skill  Level 

Low  Skill  Level 

13 

Military  Pay 

Test  3 

Test  4 

131 

Supplies /Equipment 

131 

Supplies/Equipment 

119 

Vehicles 

119 

Vehicles 

17 

Total  Manhours 

no 

Civilian  Manhours 

18 

Operations  Manhours 

11 1 

Military  Manhours 

19 

Technical  Services  Mhrs 

Test  5 

Test  6 

131 

Supplies /Equipment 

131 

Supplies/Equipment 

11  9 

Vehicles 

119 

Vehicles 

17 

Total  Manhours 

17 

Total  Manhours 

no 

Civilian  Manhours 

Test  7 

131 

Supplies /Equipment 

11  9 

Vehicles 

18 

Operations  Manhours 

19 

Technical  Services  Mhrs 

4)  Mid  Skill  Level 

5)  Low  Skill  Level 

The  authors  considered  Test  1  the  best  indicator  of  fire 
department  efficiency  of  the  seven  runs  for  two  reasons. 
First,  CFA  appears  to  have  successfully  determined  the 
efficient  and  inefficient  fire  departments  in  the  data  set 
(Appendix  I).  Second,  by  using  the  input  measure  "skill 
level"  as  a  surrogate  for  total  manpower,  a  manager  can 
determine  how  well  his  organization  is  doing  compared  to 
similar  units  and  can  determine  whether  or  not  his  mix  of 
current  skill  levels  needs  revision.  A  more  detailed 
analysis  of  the  CFA  output  reports  and  their  usefulness  to 
a  Fire  Chief  or  manager  will  be  discussed  later  in  this 
chapter  and  in  Chapter  VII. 

Test  2  Analysis.  Test  2  substituted  the  two  inputs 
"Civilian  Pay  (12)"  and  "Military  Pay  (13)"  for  the  three 
skill  level  inputs  used  in  Test  1 .  This  particular  run  was 
unsuccessful.  CFA  analysis  was  incomplete  because  of 
potential  unboundedness.  This  error  results  in  cases  where 
an  extremely  wide  range  of  data  values  causes  extremely 
small  and  extremely  large  computed  values,  which  in  turn 
cause  ill-conditioned  matrices  and  unbounded  linear 
programming  solutions.  The  ill-conditioned  matrix  problem 
which  occurs  during  matrix  inversion  is  a  difficulty 
frequently  encountered  by  linear  programming  codes. 

Test  3  Analysis.  Test  3  interchanged  input  variables 
"Civilian  Pay  (12)"  and  "Military  Pay  (13)"  with  "Total  Fire 


Department  Manhours  (17)",  "Operations  Branch  Manhours 
(18)",  and  "Technical  Services  Branch  Manhours  (19)".  This 
run  was  also  unsuccessful  because  of  potential 
unboundedness.  The  input  variables  appear  to  be  causing 
this  error.  The  difference  in  size  of  each  fire  department 
inherently  may  be  causing  the  large  range  of  values  in  a 
variable.  The  matrix  inversion  problem  is  the  same  as  found 
in  Test  2,  and  appears  to  occur  whenever  "Total  Manhours"  is 
used  in  conjunction  with  its  subsets. 

Test  4  Analysis.  Test  4  replaced  the  input  variables 
total  fire  department.  Operations,  and  Technical  Services 
manhours  with  "Civilian  Manhours  (110)"  and  "Military 
Manhours  (111)".  This  particular  test  run  introduced 
another  type  of  CFA  error  where  negative  right  hand  side 
values  were  introduced  into  the  linear  programming  matrix 
causing  CFA  to  cease  analyzing  certain  fire  departments. 

This  error  is  also  caused  by  one  or  more  variables  with  very 
large  range  of  values.  However,  the  authors  were  able  to 
build  a  CFA  summary  file  and  lambda  file  (to  be  discussed 
later  in  this  chapter)  by  omitting  the  units  CFA  stopped 
processing  due  to  the  error.  CFA  analyzed  each  fire 
department  up  to  the  one  where  the  negative  right  hand  side 
value  was  introduced.  When  the  error  caused  CFA  analysis  to 
stop,  the  authors  reprogrammed  CFA  to  analyze  the  fire 
departments  starting  immediately  after  the  one  where  the 
error  occured.  This  particular  method  produced  meaningful 


analytical  results  for  60  of  the  63  fire  departments  in  the 
reference  set. 

Test  5  Analysis.  Test  5  evaluated  eight  outputs  and 
three  inputs.  The  three  inputs  were:  1)  "Supply/Equipment 
(131)",  2)  "Vehicles  (119)",  and  3)  "Total  Manhours  (17)". 

The  effect  of  leaving  out  the  manhour  breakouts  of  the 
Operations  and  Technical  Services  Branch  of  Test  3  was  a 
successful  CFA  run. 

When  the  output  file  for  this  run  was  requested,  the 
authors  discovered  that  one  of  the  units  was  given  a  zero 
lower  bound  efficiency  rating.  Management  should  carefully 
examine  the  data  of  the  unit  receiving  the  zero  rating  to 
determine  if  data  errors  caused  the  excessively  low  rating. 

Test  6  and  7  Analysis.  These  two  tests  included  the 
eight  outputs  used  in  the  previous  tests  and  four  inputs. 
Test  6  used  the  inputs  of  Test  5  and  added  "Civilian 
Manhours  (110)".  This  test  run  was  unsuccessful  and 
produced  a  potential  unboundedness  error. 

Test  7  was  similar  to  Test  6  except  the  input  variables 
total  manhours  and  civilian  manhours  were  replaced  by  the 
inputs  "Operation  Manhours  (18)"  and  "Technical  Services 
Manhours  (19)".  This  run  was  also  unsuccessful  because  of 
potential  unboundedness.  The  authors  hypothesize  that  when 
"total  manhour"  values  are  used  in  conjunction  with  their 
subelements  the  matrix  inversion  process  becomes  unbounded. 
The  data  collected  in  these  variables  have  extremely  large 


ranges  of  values  that  CFA  or  other  linear  programs  would 
find  difficult  to  handle. 

Summary  of  CFA  Errors 

The  problems  encountered  with  the  CFA  code  are  data 
related.  A  large  range  of  values  in  the  manhour  variable 
appears  to  have  caused  the  potential  unboundedness  errors. 
Any  variable  with  a  large  range  of  values  could  cause  the 
CFA  code  to  stop  processing  the  data  set. 

Two  possible  solutions  to  potential  unboundedness  are 
suggested  below: 

1 )  Reduce  the  reference  set  by  including  only  those 
DMUs  with  data  not  having  large  ranges  of  values  for  a 
variable.  The  range  can  be  examined  statistically  using  the 
SPSS  subroutine  CONDESCRIPTIVE. 

2)  Divide  all  measures  by  one  of  the  inputs.  This 
would  normalize  the  data  (or  shrink  the  range  of  the 
measure)  and  might  alleviate  the  potential  unboundedness 
error. 

The  other  error  was  negative  right  hand  sides.  This 
error  also  appears  to  be  caused  by  large  ranges  of  measured 
values.  The  solutions  mentioned  above  for  potential 
unboundedness  might  solve  this  error  as  well. 

Summary  of  Test  Results 

The  three  successful  test  runs  (Tests  1,4,  and  5), 
although  different  in  some  respects  (input  combinations 
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used),  do  show  similarities.  Each  had  approximately  the 
same  number  of  efficient  and  inefficient  units,  and  each 
produced  similar  efficiency  results.  Comparative  facet 
tables  for  Tests  1,  4,  and  5  are  contained  in  Appendix  J. 

In  the  next  section  of  this  chapter  a  more  detailed  analysis 
of  Test  1 ,  and  examples  of  the  three  different  types  of 
inefficiency  conditions  (fully  enveloped,  not  fully 
enveloped,  and  outlier  units)  will  be  discussed. 

Files  Generated  by  thg>  CFA  Program 

The  constrained  facet  analysis  results  are  provided  in 
three  files:  the  summary,  lambda,  and  output  (consisting  of 
input  and  output  change  reports)  files.  The  summary  file 
provides  the  observed  input  and  output  values,  the 
multipliers  (see  Chapter  IV)  and  the  slack  value  (see 
Chapter  IV)  for  each  fire  department  ( DMU ) .  An  example  of  a 
summary  file  entry  for  DMU  33  is  shown  in  Figure  6.1. 

The  lambda  file  lists  all  the  inefficient  DMUs,  the 
efficient  DMUs  included  in  that  unit's  facet,  and  the 
associated  lambda  values  (as  described  in  Chapter  IV).  A 
sample  lambda  file  entry  for  DMU  33  is  shown  in  Figure  6.2. 

The  third  available  file  is  in  two  parts,  the  output 
change  report  and  the  input  change  report.  For  each  DMU, 
the  output  change  report  provides  values  of  each  output 
which  would  cause  the  DMU  to  be  rated  efficient  given  that 
the  current  input  levels  are  maintained.  These  output 
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slack  values  upper  bound  of  efficiency 
multiplier  values  lower  bound  of  efficiency 
observed  input/output  values 
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Figure  6.2  Sample  Entry  from  CFA  Lambda  File 


values  are  computed  by  multiplying  the  observed  output 
amounts  by  the  reciprocal  of  the  lower  bound  efficiency 
measure.  In  a  similar  manner,  the  input  change  report 
provides  input  values  which  would  cause  the  unit  to  be  rated 
efficient  given  that  output  values  are  held  constant.  These 
values  are  computed  by  multiplying  the  current  input  values 
by  the  lower  bound  efficiency  measure.  In  both  reports,  the 
percent  contribution  of  each  input  and  output  measure  to  the 
efficiency  of  the  DMU  is  also  provided.  The  percentage  is 
the  product  of  the  individual  measurement  multiplier  and  the 
measurement  value.  Figure  6.3  shows  the  output  change 
report  and  Figure  6.4  shows  the  input  change  report  for  DMU 
33.  The  lambda  values  for  each  DMU  are  printed  at  the  end 
of  the  input. change  report  for  ease  of  reference. 

Results  of  CFA  Test  1 

The  remainder  of  this  chapter  will  present  the  results 
of  CFA  for  input/output  Test  1 .  The  summary  file  for  this 
run  is  contained  in  Appendix  K.  It  details  the  multiplier 
and  slack  value  information  for  35  efficient  and  27 
inefficient  units.  The  upper  and  lower  bound  efficiencies 
for  the  inefficient  units  are  shown  in  Table  6.2.  Appendix 
L  contains  the  lambda  file  for  this  run,  the  listing  of 
facet  members  and  associated  lambda  values  for  each 
inefficient  unit. 

To  illustrate  managerial  use  of  the  results  of  the  CFA 
evaluation,  three  DMU's  will  be  considered  in  depth,  each 
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*  SUMMARY  OF  RESULTS  * 
********************** 


EFFICIENCY  RANGE  =  75.4  TO  75.4  PERCENT 
MULTIPLIER  FOR  EFFICIENT  OUTPUT  LEVELS  =  1.326 


*********** 
*  OUTPUTS  * 


OBSERVED 

VALUES 

EFFICIENT 

OUTPUT 

LEVELS 

PERCENT 
CONTRIBUTIONS 
TO  EFFICIENCY 

RESPONSES  . 

412.0 

626.4 

0 

STANDYBYS 

• 

174.0 

989.2 

* 

0 

TRAINING 

376.0 

528.1 

0 

INSPNS 

1492.0 

1979.1 

8.7 

L  AND  T 

74556.0 

98895.4 

14.8 

RP  RISK 

5165.0 

6851.2 

2.2 

POP 

5221  .0 

6925.4 

3.1 

STATIONS 

1  .0 

1  .3 

46.6 

TOTAL  :  75.4  PERCENT 


Figure  6.3  Sample  Entry  from  CFA  Output  Change  Report 


*  INPUTS  * 


OBSERVED 

VALUES 

NO  INPUT 

CHANGES 

REQUIRED 

RELATIVE 

IMPORTANCE 

OF  INPUTS 

SUPP/EQP 

38393.0 

56.9 

HI  MHRS 

9.0 

29.4 

MID  MHRS 

29.0 

13.7 

LO  MHRS 

23.0 

0 

VEHICLES 

16.0 

0 

TOTAL  :  100.0  PERCENT 

Figure  6-.  3  Continued 
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★★★★★★★★★★★★★★★★★★★★★★ 

*  SUMMARY  OF  RESULTS  * 

★  ★★★★★★★★★★★★★★★★★★★★It 


EFFICIENCY  RANGE  *  75.4  TO  75.4  PERCENT 
MULTIPLIER  FOR  EFFICIENT  INPUT  LEVELS  = 


★★★★★★★★★★★ 
*  OUTPUTS  * 


OBSERVED 

VALUES 


NO  OUTPUT 

CHANGES 

REQUIRED 


.754 


PERCENT 
CONTRIBUTION 
TO  EFFICIENCY 


RESPONSES 

412.0 

0 

STANDBYS 

174.0 

0 

TRAINING 

376.0 

0 

INSPNS 

1492.0 

8.7 

L  AND  T 

74556.0 

14.8 

RP  RISK 

5165.0 

2.2 

POP 

5221 .0 

3.1 

STATIONS 

1  .0 

46.6 

TOTAL 


75.4  PERCENT 


Figure  6.4  Sample  Entry  from  CFA  Input  Change  Report 


*  INPUTS  * 


OBSERVED 

VALUES 

EFFICIENT 

INPUT 

LEVELS 

RELATIVE 
IMPORTANCE 
OF  INPUTS 

SUPP/EQP 

38393.0 

28937.8 

56.9 

HI  MHRS 

9.0 

6.8 

29.4 

MID  MHRS 

29.0 

21  .9 

13.7 

LO  MHRS 

23.0 

8.2 

0 

VEHICLES 

16.0 

7.4 

0 

TOTAL  :  100.0  PERCENT 


CFA  MODEL  OF  EFF  FOR. AIR  FORCE  FIRE  DEPT 
DECSION  MAKING  UNIT  25  600600330 


**************************************** 

**************************************** 


X 

300700080 

.33203 

X 

3007001 20 

.11638 

X 

900500730 

.11459 

X 

900600710 

.03646 

X 

200700020 

.05644 

X 

200500030 

.061 72 

X 

700400400 

-  .04049 

Figure  6.4  Continued 


TABLE  6.2 


Bounds  of 

Efficiencies  for 

Inefficient  Units 

Organization 

( DMU ) 

Lower  Bound 

Efficiency 

Upper  Bound 

1 

.66562 

.681 37 

1  7 

.49013 

.80792 

20 

.51300 

.8771 6 

23 

.70716 

.70716 

24 

.57660 

.68262 

31 

.67728 

.71 226 

32 

.54864 

.54-864 

33 

*  .54037 

.75373 

34 

.49499 

.60591 

37 

.46016  ft 

.58693 

39 

.54844 

.90707 

41 

.82956 

.88555 

43 

.67099 

.98074 

48 

.66644 

.66644 

49 

.59317 

.74958 

51 

.50039 

.76143 

52 

.73909 

.90669 

54 

.44634 

.5591 8 

55 

.63301 

.67861 

56 

.69906 

.71078 

57 

.70317 

.9491 9 

59 

.37655 

.68892 

61 

.52847 

.70674 

63 

.33539 

.95237 

64 

.65618 

.98060 

70 

.60687 

.83235 

72 

.601 74 

.70955 

illustrating  a  different  level  of  envelopment.  In  each 
consideration,  the  following  properties  of  the  CFA  model 
should  be  kept  in  mind.  A  DMU  will  have  an  efficiency  of 
1.00  only  when: 

(a)  None  of  its  outputs  can  be  increased  without  either 

(i)  Increasing  one  or  more  of  its  inputs  or 

(ii)  Decreasing  some  of  its  other  outputs 

(b)  None  of  its  inputs  can  be  decreased  without  either 

(i)  Decreasing  some  of  its  outputs  or 

(ii)  Increasing  some  of  its  other  inputs. 

[17:2] 

CFA  Results  for  DMU  48.  As  noted  in  Chapter  IV,  a  DMU 
efficiency  rating  developed  by  CFA  is  relative  to  other  DMUs 
in  a  facet.  The  lower  bound  efficiency  for  DMU  48  is  .66644 
and  the  upper  bound  is  also  .66644.  The  fact  that  the 
values  are  equal  and  that  there  are  1'2  efficient  units  in 
the  facet  (number  of  inputs  +  number  of  outputs  •*  1 ) 
indicates  that  the  unit  is  fully  enveloped.  Table  6.3  shows 
data  for  DMU  48  and  for  the  efficient  DMUs  in  its  facet. 

The  entries  were  developed  by  dividing  all  measured  values 
of  each  DMU  in  the  table  by  that  DMU's  measured  value  for 
the  number  of  vehicles.  This  procedure  effectively  scales 
the  input  and  output  measures  for  ease  of  comparison.  The 
scaling  in  no  way  affects  the  efficiency  ratings  described 
in  Chapter  IV  and  Appendix  D.  Table  6.4  shows  multiplier 
values  for  this  unit  and  the  DMUs  in  its  proper  facet.  The 
full  envelopment  of  DMU  48  is  evident  when  its  measurement 
values  are  compared  to  the  range  of  values  for  the  facet  in 


;  48  Obse 
•ved  and 
.cient  Fi 


es  per  Vehicle 
alues  per  Vehicle 
ments 


DMU 

Vehicle 

(119) 

Respons 

(043) 

Standby 

(044) 

Traing 

(048) 

Inspect 

(025) 

L  and  T 
(032) 

RP  Risk 
(034) 

3 

1 

(17) 

137.29 

158.11 

48.64 

576.29 

8247.94 

1740.76 

11 

1 

(15) 

76.80 

138.93 

35.66 

54.13 

32359.86 

479.53 

16 

1 

(14) 

68.35 

2.85 

83.28 

88.28 

44038.64 

594.07 

21 

1 

(7) 

90.85 

5.28 

168.85 

395.14 

1.57 

727.00 

38 

1 

(18) 

75.27 

35.72 

96.66 

123.72 

12333.33 

1284.66 

44 

1 

(13) 

40.76 

116.30 

82.76 

256.53 

3376.92 

47975.84 

53 

1 

(14) 

47.14 

89.00 

175.92 

324.28 

4436.14 

5082.07 

60 

1 

(15) 

59.53 

11.40 

132.00 

250.40 

3603.86 

1582.86 

62 

1 

(12) 

165.08 

66.41 

41.16 

107.83 

2324.08 

521.41 

65 

1 

(15) 

124.73 

155.60 

119.06 

117.86 

3715.33 

18611.60 

66 

1 

(18) 

52.44 

47.60 

269.16 

58.05 

3748.16 

375.44 

67 

1 

(16) 

193.43 

67.37 

24.25 

125.12 

9307.06 

1004.62 

AVE 

1 

(14. *5) 

94,30 

74.54 

106.45 

• 

206.46 

10624.40 

6664.98 

48 

1 

(12) 

56.08 

12.91 

124.25 

193.16 

1741.16 

780. 9l| 

DMU 

Pop 

(036) 

Station 

(039) 

Sup/Eqp 

(131) 

Hi  SL 
(132) 

Mid  SL 
(114) 

Low  SL 

(115) 

3 

1212.00 

.11 

4892.41 

.88 

3.82 

1.00 

11 

226.66 

.06 

13336.80 

.53 

3.33 

.46 

16 

750.00 

.14 

14360.28 

1.07 

2.14 

.92 

21 

371.42 

.14 

4000.00 

.71 

3.57 

.85 

38 

892.44 

.27 

15542.72 

.50 

1.83 

.61 

44 

84.61 

.07 

17045.61 

.76 

2.15 

.15 

53 

678.57 

.07 

14243.21 

.50 

3.21 

.71 

60 

3289.90 

.13 

11971.53 

.53 

4.00 

.60 

62 

693.16 

.08 

12167.58 

.58 

3.25 

.75 

65 

822.46 

.13 

10383.33 

1.20 

3.00 

.33 

66 

600.00 

.05 

4239.66 

.77 

.50 

1.05 

67 

793.75 

.12 

10376.75 

1.06 

2.68 

.62 

AVE 

867.90 

.11 

11046.65 

.75 

2.79 

.67 

48 

542.25 

.08 

9236.50 

.75 

3.08 

.33 

DMU 

Respons 

(043) 

Standby 

(044) 

Traing 

(048) 

Inspect 

(025) 

L  and  T 
(032) 

RP  Risk 
(034) 

Pop 

(036) 

3 

.000249 

.000056 

.000010 

.000007 

.000001 

.000001 

.000000 

11 

.000342 

.000196 

.000010 

.000000 

.000000 

.000001 

.000000 

16 

.000160 

.000001 

.000010 

.000012 

.000001 

.000001 

.000000 

21 

.000360 

.000232 

.000455 

.000079 

.000002 

.000001 

.000000 

38 

.000194 

.000001 

.000029 

.000000 

.000001 

.000001 

.000002 

44 

.000174 

.000122 

.000010 

.000026 

.000000 

.000001 

.000000 

53 

.000367 

.000001 

.000228 

.000018 

.000000 

.000001 

.000005 

60 

.000000 

.000001 

.000010 

.000000 

.000000 

.000001 

.000019 

62 

.000422 

.000015 

.000228 

.000000 

.000001 

.000001 

.000000 

65 

.000294 

.000013 

.000010 

.000000 

.000000 

.000001 

.000000 

66 

.000287 

.000039 

.000143 

.000000 

.000000 

.000001 

.000000 

67 

.000261 

.000001 

.000010 

.000000 

.000000 

.000001 

.000011 

48 

.000356 

.000001 

.000211 

.000024 

.000001 

.000001 

.000004 

Table  6.3.  The  values  for  DMU  48  are  always  within  the 
range,  never  being  the  highest  or  lowest  entry. 

CFA  Results  for  DMU  63.  DMU  63  illustrates  another 
type  of  unit,  the  outlier.  The  lower  bound  efficiency  for 
this  unit  is  .33539  (the  lowest  in  the  set),  the  upper  bound 
is  .95237  and  there  are  only  eleven  efficient  units  in  its 
facet.  Table  6.5  shows  the  measures  per  vehicle  for  each 
efficient  DMU  in  the  facet  along  with  the  measures  per 
vehicle  for  DMU  63.  Note  that  the  standbys  per  vehicle  and 
supplies/equipment  per  vehicle  for  DMU  63  were  higher  than 
any  in  the  facet  and  the  real  property  at  risk  per  vehicle 
and  stations  per  vehicle  were  lower  than  any  in  the  facet. 
The  fact  that  these  values  are  near  the  upper  or  lower  limit 
of  values  in  the  facet  identifies  that  the  values  of  DMU  63 
are  outliers  and  that  DMU  63  is  an  outlier  unit.  The 
multipliers  for  this  facet,  shown  in  Table  6.6,  show  how  the 
model  minimized  the  effect  of  the  low  output  value  for  real 
property  at  risk  and  the  high  input  value  for  supplies  and 
equipment  by  assigning  multiplier  values  near  zero  in  order 
to  achieve  the  highest  efficiency  rating  possible.  Without 
more  in-depth  analysis  of  this  unit,  it  is  impossible  to 
determine  if  the  actual  efficiency  is  in  the  lower  or  upper 
portion  of  the  efficiency  range. 

The  presentation  of  values  in  Table  6.5  also  points  out 
the  effect  on  the  model  of  incorrect  data  elements.  The 
values  for  high,  mid  and  low  skill  level  personnel  for  DMU  4 


TABLE  6.6 


Multiplier  Values  for  the  Proper  Facet  of  Fire  Department  63 


DMU 

Respons 

(043) 

Standby 

(044) 

Traing 

(048) 

Inspect 

(025) 

L  and  T 
(032) 

RP  Risk 
(034) 

Pop 

(036) 

2 

.000031 

.000001 

.000022 

.000036 

.000000 

.000001 

.000000 

3 

.000249 

.000056 

.000010 

.000007 

.000001 

.000001 

.000000 

4 

.000000 

.000154 

.000010 

.000071 

.000001 

.000001 

.000013 

9 

.000115 

.000001 

.000010 

.000078 

.000002 

.000003 

.000042 

14 

.000000 

.000001 

.000010 

.000004 

.000002 

.000001 

.000022 

30 

.000000 

.000194 

.000010 

.000050 

.000001 

.000001 

.000016 

44 

.000174 

.000122 

.000010 

.000026 

.000000 

.000001 

.000000 

60 

.000000 

.000001 

.000010 

.000000 

.000000 

.000001 

.000019 

65 

.000294 

.000013 

.000010 

.000000 

.000000 

.000001 

.000000 

69 

.000091 

.000034 

.000010 

.000000 

.000000 

.000001 

.000015 

73 

.000000 

.000001 

.000010 

.000367 

.000000 

.000001 

.000000 

63 

.000017 

.000012 

0 

.000011 

.000000 

.000000 

.000006 

DMU 

Station 

(039) 

Sup/Eqp 

(131) 

Vehicle 

(119) 

Hi  SL 
(132) 

Mid  SL 
(114) 

Low  SL 
(115) 

2 

.127667 

.000003 

.000010 

.002319 

.007811 

.000010 

3 

.000010 

.000001 

.000010 

.109554 

.000010 

.000010 

4 

.214634 

.000000 

.061156 

.000010 

.019977 

.000010 

9 

.020104 

.000006 

.011494 

.000010 

.025507 

.000010 

14 

.000010 

.000000 

.038923 

.011128 

.000010 

.069294 

30 

.000010 

.000007 

.000010 

.018485 

.000010 

.043490 

44 

.000010 

.000003 

.000010 

.000010 

.013654 

.000010 

60 

.000010 

.000004 

.000010 

.004243 

.000010 

.030440 

65 

.000010 

.000002 

.004211 

.031105 

.000010 

.015708 

69 

.000010 

.000003 

.000010 

.013730 

.002558 

.000010 

73 

.000010 

.002262 

.000010 

.031647 

.000010 

.000010 

63 

.066333 

.000001 

.005164 

.000618 

.002316 

.009382 

were  zero  since  the  values  could  not  be  ascertained  at  the 
time  the  data  was  processed.  Since  these  values  made  up  a 
large  portion  of  the  input  measures,  the  ultimate  effect  was 
to  make  unit  4  efficient  when  in  actuality  it  may  not  have 
been.  With  the  knowledge  that  this  unit  may  not  be  a  valid 
facet  member,  its  values  were  not  included  in  the  average 
figures. 

CFA  results  for  DMU  33.  DMU  33  illustrates  still 
another  aspect  of  the  CFA  analysis.  The  lower  bound 
efficiency  was  .54037,  the  upper  bound  was  .75373,  and  the 
number  of  units  in  its  facet  was  seven.  The  unit  is  not 
enveloped  and  the  basis  is  incomplete  which  leads  to  non¬ 
zero  slack/surplus  values  in  five  variables.  The  values 
indicated  in  the  summary  file  for  unit  33  (shown  in  Figure 
6.1)  are  derived  on  the  first  iteration  of  the  CFA  linear 
programming  model  and  represent  the  adjustment  required  at 
this  point  to  force  the  unit  to  be  efficient.  Particularly 
noticeable  for  unit  33  is  the  slack  value  of  14303.698 
compared  to  the  variable  value  of  5165.00  for  real  property 
at  risk.  Obviously  this  is  a  nondiscretionary  variable  and 
any  adjustments  to  improve  efficiency  would  have  to  take 
place  in  some  other  area. 

The  data  for  the  facet  of  DMU  33  shown  in  Table  6.7  and 
the  multipliers  shown  in  Table  6.8  illustrate  the  manner  in 
which  CFA  attempts  to  ignore  or  minimize  outlier  values. 

This  was  especially  noticeable  in  the  zero  multipliers 


DMU 

Vehicle 

(119) 

Respons 

(043) 

Standby 

(044) 

Traing 

(048) 

Inspect 

(025) 

L  and  T 
(032) 

RP  Risk 
(034) 

2 

1 

(19) 

60.26 

110.84 

60.53 

318.42 

6542.63 

852.74 

3 

1 

(17) 

137.29 

158.12 

48.65 

576.29 

8247.94 

1740.76 

8 

1 

(6) 

45.17 

1.33 

62.67 

138.67 

0 

378.67 

12 

1 

(15) 

24.60 

280.73 

56.80 

8.07 

33821.40 

429.33 

40 

1 

(16) 

35.12 

91.19 

92.00 

121.31 

1140.63 

977.13 

71 

1 

(15) 

66.20 

151.40 

78.47 

52.20 

240.00 

411.73 

73 

1 

(14) 

85.29 

81.79 

51.14 

190.50 

261.36 

827.86 

AVE 

1 

(14.6) 

64.84 

125.05 

64.32 

200.78 

7179.13 

802.60 

33 

1 

(16) 

25.75 

10.88 

23.50 

93.25 

4659.75 

322.81 

DMU 

Pop 

(036) 

Station 

(039) 

Sup/Eqp 

(131) 

Hi  SL 
(132) 

Mid  SL 
(114) 

Low  SL 
(115) 

2 

1453.32 

.26 

8633.11 

.74 

3.05 

1.26 

3 

1212.00 

.12 

4892.41 

.83 

3.82 

1.00 

8 

511.16 

.17 

2521.50 

1.17 

3.17 

1.67 

12 

216.47 

.13 

6770.40 

.67 

2.27 

1.13 

40 

728.19 

.19 

3567.00 

1.25 

2.44 

.63 

71 

413.47 

.07 

0 

.60 

4.07 

.67 

73 

773.14 

.07 

13.57 

1.29 

2.29 

.36 

AVE 

758.25 

.14 

1077.46 

.94 

3.01 

.96 

33 

326.31 

.06 

2399.56 

.56 

1.81 

1.44 

Multiplier  Values  for  the  Proper  Facet  of  Fire  Department  33 


DMU 

Respons 

(043) 

Standby 

(044) 

Traing 

(048) 

Inspect 

(025) 

L  and  T 
(032) 

RP  Risk 
(034) 

Pop 

(036) 

2 

.000031 

.000001 

.000022 

.000036 

.000000 

.000001 

.000000 

3 

.000249 

.000056 

.000010 

.000007 

.000001 

.000001 

.000000 

8 

.000592 

.000001 

.000116 

.000000 

.000000 

.000001 

.000000 

12 

.000383 

.000014 

.000147 

.000000 

.000001 

.000001 

.000000 

40 

.000219 

.000001 

.000023 

.000000 

.000000 

.000002 

.000003 

71 

.000986 

.000001 

.000010 

.000000 

.000000 

.000001 

.000000 

73 

.000000 

.000001 

.000010 

.000367 

.000000 

.000001 

.000000 

33 

.000200 

.000027 

0 

0 

.000001 

0 

.000003 

DMU 

Station 

(039) 

Sup/Eqp 

(131) 

Vehicle 

(119) 

Hi  SL 
(132) 

Mid  SL 
(114) 

Low  SL 
(115) 

2 

.127667 

.000003 

.000010 

.002319 

.007811 

.000010 

3 

.000010 

.000001 

.053428 

.000323 

.000010 

.000010 

8 

.793427 

.000014 

.131118 

.000010 

.000010 

.000010 

12 

.000010 

.000003 

.000010 

.066070 

.000010 

.000010 

40 

.261083 

.000004 

.000010 

.009216 

.014218 

.002733 

71 

.000010 

.099905 

.000010 

.000010 

.000010 

.000010 

73 

.000010 

.002262 

.000010 

.031647 

.000010 

.000010 

33 

.341173 

.037674 

.000009 

.006887 

0 

0 

assigned  in  Table  6.8  for  training,  inspections,  real 
property  at  risk,  mid  skill  level,  and  low  skill  level 


DMU  Relative  Efficiencies 

It  has  been  shown  how  important  it  is  to  have  complete 
information  about  the  efficient  units  in  a  facet  in  order  to 
draw  conclusions  about  the  inefficient  unit.  Additional 
conclusions  about  efficient  (frontier)  units  can  be  drawn  by 
considering  the  number  of  appearances  of  those  units  in  the 
facets  of  inefficient  ones.  Table  6.9  shows  the  number  of 
appearances  of  each  efficient  DMU  in  the  facet  of  an 
inefficient  DMU. 

Note  that  units  13,  25,  46  and  47  do  not  appear  in  any 
facet  of  any  inefficient  unit.  It  is  thus  possible  to 
comment  that  these  units  may  not  actually  be  efficient,  but 
appear  to  be  so  only  because  of  special  descriptive 
features.  On  the  other  hand,  unit  44  appears  in  the  facets 
of  25  of  the  27  inefficient  units,  strong  evidence  of  its 
relative  efficiency.  This  information  is  useful  for 
management  in  analyzing  the  effect  that  DMU  behavior  has  on 
the  efficiency  of  other  units  and  also  in  determining 
relative  optimal  combinations  of  measurement  values. 

The  next  chapter  will  introduce  the  manager's  use  of 
the  input  and  output  change  reports  and  describe  a  proposal 
to  integrate  CFA  into  a  Civil  Engineering  automated 
management  system. 
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Due  tu  a  CKA  code  idiosyncracy ,  this  unit  appears  in  both  the  efficient  and  inefficient  sets 


VII .  Air  Force  Fire  Protection  Automated 
Management  System 

This  chapter  develops  the  use  of  the  results  of 
Constrained  Facet  Analysis  ( CFA )  by  the  individual  Fire 
Chiefs  and  by  the  Major  Commands  and  also  discusses  the 
integration  of  CFA  into  a  Civil  Engineering  automated 
management  system. 

Use  and  Distribution  of  CFA  Results 

The  products  generated  by  CFA  provide  management 
information  for  all  levels  in  Civil  Engineering.  The 
summary  and  lambda  files  are  most  useful  at  MAJCOM  and  Air 
Staff  levels.  Here  broad  evaluations  of  efficiency  and 
effectiveness  can  be  applied  across  base  and  MAJCOM 
organizational  boundaries.  As  stated  in  the  problem 
statement  in  Chapter  I,  efficiency  is  not  the  only  criterion 
of  interest  in  the  management  of  fire  departments. 
Effectiveness  goals  must  also  be  addressed.  Perhaps  several 
fire  departments,  including  some  of  the  frontier  units,  have 
been  producing  levels  of  output  which  are  considered  to  be 
too  low  by  managers.  Perhaps  goals  should  be  established  in 
an  attempt  to  increase  levels  of  achievement  of  units,  thus 
improving  their  effectiveness. 

Effectiveness,  as  defined  in  Chapter  I,  is  the  ability 


of  an  organization  to  attain  its  goals.  In  the  case  of  Air 
Force  Fire  Departments,  this  involves  mission  support  as 


specified  in  both  the  strategic  (long-range)  and  tactical 
(short-range)  planning  processes.  The  Fire  Department,  as 
any  military  organization,  should  use  this  process  to  set 
its  long-range  g^als  and  the  short-range  goals  that  support 
them.  To  achieve  the  desired  results,  the  Fire  Chief  should 
guide  and  lead  the  department ' s  members  indirectly  toward 
the  establishment  and  achievement  of  these  lower  level 
goals.  The  long-range  goal  of  constructing  a  new  fire 
station,  staffing  it,  and  equipping  it  with  apparatus  would 
require  yearly  strategic  and  operational  goals  by  MAJCOMs. 
Decisions  about  features  of  specific  pieces  of  apparatus  and 
for  equipment  to  go  in  the  new  station,  based  on  past  and 
projected  record  of  fire  department  activities,  are  required 
sometimes  in  a  short  period  of  time. 

In  order  for  a  fire  department  to  operate  effectively 
and  efficiently,  personnel  should  be  selected  and  allocated 
where  needed  to  take  advantage  of  the  new  employees ’ 
abilities  and  leadership.  Likewise,  vehicles  and  equipment 
should  be  allocated  to  organizations  that  can  benefit  the 
most.  CFA  provides  a  way  to  look  at  the  total  labor  force 
and  identify  efficient  and  inefficient  units  so  MAJCOMs  can 
allocate  senior  noncommissioned  officers  (NCOs)  to 
inefficient  units,  even  though  an  efficient  fire  department 
may  also  need  an  NCO.  Presently,  allocation  of  this 
resource  is  an  opinionated  evaluation  performed  by  Major 
Command  managers. 


Vehicles  are  allocated  based  on  age  and  mission  of  the 
fire  department.  Managers  at  the  MAJCOM  are  provided  input 
from  an  automated  tool  referred  to  as  the  Vehicle  Integrated 
Management  System  (VIMS)  maintained  by  the  Transportation 
Branch.  VIMS  forecasts  vehicle  replacements  based  on  the 
factors  listed  above.  After  VIMS  identifies  old  vehicles  to 
be  replaced  or  new  vehicles  available  for  distribution  to 
fire  departments,  MAJCOM  managers  employ  individual 
subjective  evaluations  and  decisions  on  who  gets  the  new 
vehicles.  If  MAJCOMs  had  the  CFA  results  indicating  the 
role  of  vehicles  in  the  efficiency  of  a  unit,  their 
decisions  could  be  more  objective  and  justifiable. 

The  output  product  consisting  of  the  input  and  output 
change  reports  is  published  for  and  distributed  to  the  DMU 
manager,  in  this  case  the  individual  Fire  Chief.  The  report 
provides  the  following  information: 

the  efficiency  rating  of  the  Fire  Department 

the  input  and  output  values  used  for  the  analysis  of 
the  unit 

the  ouput  values  needed  to  attain  efficiency  of  1 .00 
if  current  inputs  are  maintained 

the  input  values  needed  to  attain  efficiency  of  1.00 
if  current  outputs  are  maintained 

the  relative  contributions  of  individual  outputs  and 
inputs  to  the  lower  bound  efficiency  rating 

the  identification  of  the  efficient  departments  that 
have  input  levels  similar  to  that  Fire  Department 
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The  Fire  Chief  then  can  set  his  own  management  goals 
and  be  aware  of  the  departments  from  which  to  gain 
information  on  improving  his  efficiency. 

Automated  Management  System 

In  order  to  manage  its  fire  protection  program,  the  Air 
Force  is  faced  with  the  problem  of  measuring  the  adequacy  of 
its  fire  protection  resources.  Traditionally,  this 
measurement  has  been  fragmented.  A  variety  of  methods  have 
been  used,  including  Major  Command  Staff  visits.  Inspector 
General  visits  and  a  diverse  range  of  reporting  procedures. 
In  general,  these  have  been  less  than  totally  satisfactory 
(29:1  ). 

The  Air  Force  Fire  Protection  Program  needs  a  system 
that  will  provide  improved  fire  protection  measurement. 
Ultimately,  the  goal  is  to  provide  decision  makers  at  all 
levels  in  the  program  with  improved  information  on  which  to 
base  decisions  relative  to  future  directions  for  Air  Force 
fire  protection.  Three  goals  at  the  individual  installation 
level  include: 

1 )  provide  an  objective  evaluation  of  the  installation 
fire  protection  program  based  on  actual  measures  of  inputs 
and  outputs; 

2)  identify  specific  deficiencies  at  specific  Air 
Force  installations  and  provide  relative  priorities  for 
corrective  action;  and 
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3)  recommend  corrective  actions  for  identified 
deficiencies. 

The  goals  at  Major  Command  and  Air  Force  Headquarters  level 
should  include: 

1 )  provide  the  summary  information  regarding  overall 
fire  protection  status; 

2)  collect  data  from  the  system  that  would  indicate 
program  trends  when  accumulated  over  a  period  of  time;  and 

3)  know  the  status  and  trends  relative  to  existing 
fire  protection  requirements  and  know  which  fire  departments 
were  relatively  inefficient  compared  to  others  with  similar 
input /output  mix.  This  information  would  provide  the  basis 
for: 

a)  fire  protection  budget  requests  and 
justification; 

b)  redistribution  of  fire  protection  resources 
(e.g . ,  vehicles  and  manpower)  where  imbalances 
are  detected; 

c)  modifying  and  clarifying  fire  protection 
requirements  when  it  becomes  apparent  that  such 
action  is  warranted. 

Finally,  such  a  system  would  provide  a  structured  base 
of  information  relative  to  existing  and  projected  fire 
protection  resources  that  could  be  correlated  with  actual 
fire  incident  experience.  By  jointly  analyzing  Fire 
Department  efficiencies  and  goals,  it  would  be  possible 


to  more  accurately  evaluate  the  various  fire  protection 
alternatives.  Again,  the  end  result  would  be  an  improved 
basis  for  management  decisions  affecting  Air  Force  fire 
protection. 

The  integration  of  CFA  into  the  management  system  would 
provide  broad  based  information  on  most  aspects  of  both 
efficiency  and  effectiveness.  Uses  of  the  CFA-based  system 
include  fire  department  profiles,  contingency  planning  and 
annual  reviews  where  MAJCOMs  can  monitor  trends  that  will  be 
beneficial  in  allocating  resources  to  fire  departments. 

Fire  Department  Profiles.  In  addition  to  the  reports 
which  are  routinely  operated  by  base  level  users,  the 
MAJCOMs  can  use  the  system  to  search  for  fire  departments  in 
the  data  base  which  have  any  specified  input  and  output 
characteristics  and  they  will  be  able  to  generate  fire 
department  profiles.  The  profiles  will  include  the 
distribution  of  input,  output  and  efficiency  ratings  for 
fire  departments  which  will  indicate  how  each  department's 
resources,  effectiveness  and  efficiency  compare  to  other 
fire  departments  in  the  same  command  and  to  those  Air  Force 
wide. 

Contingency  Planning.  Another  area  where  a  CFA-based 
system  can  help  MAJCOM  planners  is  its  use  in  wartime  and 
contingency  planning.  A  MAJCOM  can  manipulate  the  input  and 
output  measures  to  reflect  changes  in  contingency  situations 
and  forecast  efficient  and  inefficient  fire  departments.  In 


this  situation  all  military  will  leave  the  CONUS  base, 
aircraft  sorties  will  increase  or  decrease,  base  missions 
will  change,  and  other  measures  will  change  depending  on  the 
installation's  wartime  commitment.  After  the  wartime 
scenario  is  established  and  CFA  applied,  one  can  determine 
where  resources  need  to  be  reallocated  to  improve  efficiency 
ratings  at  CONUS  fire  departments. 

Annual  Reviews.  Finally,  the  MAJCOMs  will  be  able  to 
review  fire  departments  on  an  annual  review  basis.  The 
annual  review  process  will  provide  a  comprehensive  method 
for  monitoring  the  status  and  trends  of  the  total  Air  Force 
Fire  Protection  Program.  MAJCOMs  will  be  able  to  obtain 
information  regarding  the  allocation  and  distribution  of 
scarce  resources  to  fire  departments.  Some  of  the  questions 
that  can  be  answered  using  information  from  the  proposed 
system  include  (12:3): 

-  How  well  are  fire  departments  meeting  goals? 

What  distribution  of  scarce  resources  would  result 
in  the  best  overall  service  levels? 

Given  existing  resource  availability,  what  level  of 
services  can  be  accomplished? 

Conclusion 

CFA  analysis  of  a  Fire  Department  has  been  shown  to 
provide  valuable  information  for  the  Fire  Chief  in  improving 
both  his  efficiency  and  effectiveness.  The  extension  of 
this  method  into  an  integrated  automated  management  system 


presents  an  opportunity  for  Civil  Engineering  managers  at 
every  level  of  management  to  use  information  and  analysis 
from  several  data  sources  to  develop  the  optimal 
productivity  improvement  strategy.  Thus,  the  best  use  of 
CFA  analysis  results  for  each  level  of  management  has  been 
proposed  and  the  fourth  research  question  answered. 


III.  Conclusions  and  Recommendations 


This  chapter  presents  the  conclusions  and 
recommendations  of  this  research.  The  conclusion  restates 
the  research  problem  and  then  summarizes  the  results  of 
each  research  objective.  The  effects  of  the  CFA  model's 
limitations  will  be  presented  in  this  chapter,  along  with 
recommendations  to  improve  the  CFA  efficiency  model  for  fire 
departments . 

Conclusions 

The  Air  Force  Engineering  and  Services  Center  ( AFESC ) 
has  supported  this  research  to  find  an  efficiency  model  that 
will  measure  fire  department  efficiency.  Measuring  the 
efficiency  of  Air  Force  fire  department  performance  is  a 
complex  problem  because  of  its  multiple  input,  multiple 
output  characteristics  and  because  of  a  lack  of  quantitative 
measures. 

Research  Objective  1 

A  comprehensive  set  of  input/output  candidates  were 
selected  using  the  list  of  tasks  developed  at  the  AFESC  Fire 
Department  functional  review  workshop.  The  data  form 
developed  to  collect  information  from  CONUS  Base  Fire 
Departments  was  reviewed  for  adequacy,  completeness,  and 
data  availability  by  Air  Force  fire  protection  experts. 


Fiscal  year  1983  data  from  81  bases  was  collected  with  the 
sponsorship  of  HQ  AFESC  through  the  CONUS  Major  Command's. 


Research  Objective  2 

The  research  reviewed  linear  regression  and  ratio 
analysis  and  determined  that  neither  can  correctly  identify 
inefficiencies  within  multiple  output,  multiple  input 
organizational  units.  These  models  cannot  capture  the 
interactions  between  inputs  and  outputs.  However,  a  new 
approach.  Constrained  Facet  Analysis  ( CFA) ,  has  been 
developed  that  does  take  into  account  simultaneously  the 
relationship  of  multiple  inputs  and  multiple  outputs  using 
empirical  data.  It  was  therefore  determined  that  CFA  was 
apparently  the  best  model  to  analyze  Fire  Department 
performance.  Once  the  CFA  model  was  selected  for  use,  the 
data  could  be  prepared  for  analysis. 

When  the  data  forms  were  returned  to  the  authors,  they 
were  screened  for  completeness  and  validity.  The  data  from 
the  63  remaining  organizations,  consisting  of  42  outputs  and 
30  inputs,  were  then  cleansed,  edited,  and  coded  into  CFA 
format.  Reduction  of  the  variables  to  satisfy  the  matrix 
dimension  constraint  of  CFA  was  the  next  step.  This  was 
accomplished  using  a  combination  of  1 )  replacing  subsets  by 
total  quantities;  2)  combining  like  data;  and 
3)  statistically  reviewing  the  data  using  Pearson 
Correlations.  The  final  data  set  contained  8  outputs  and  12 
inputs  to  be  used  in  seven  different  combinations. 


Of  the  seven  tests  run,  three  tests  produced  efficiency 
measures  that  are  valid  for  Air  Force  Fire  Departments. 
Information  on  the  efficient  units  appearing  in  proper 
facets  and  input  and  output  adjustments  to  increase  the 
efficiency  of  inefficient  units  were  shown  to  be  of  great 
assistance  to  the  Fire  department  managers.  The  other  four 
tests  were  unsuccessful  due  to  the  inablility  of  the  CFA 
program  to  manipulate  the  combinations  of  variables.  The 
major  contributor  to  the  problem  was  the  broad  range  of 
values  in  a  particular  variable  resulting  in  potential 
unboundedness  in  the  linear  programming  solution. 

Research  Objective  3 

Despite  the  limitations  of  the  current  CFA  code,  this 
analysis  method  still  produces  results  that  are  more 
meaningful  than  those  from  any  other  method  currently 
available.  The  products  generated  by  CFA  provide  efficiency 
management  information  for  all  levels  of  management  in  Civil 
Engineering.  However,  in  order  to  fully  evaluate  Fire 
Department  productivity,  effectiveness  (goal  achievement) 
must  be  addressed.  An  integrated  automated  management 
information  system  incorporating  not  only  CFA  analysis  but 
also  data  from  other  information  sources  would  enable  the 
managers  to  develop  the  optimal  productivity  strategy.  This 
automated  system  could  also  include  Fire  Department 
efficiency  profiles,  contingency  and  wartime  planning 
forecasts,  and  annual  reviews. 
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Limitations 


Use  of  the  CFA  code  as  it  presently  exists  revealed 
limitations  in  the  application  of  the  code.  Many  of  the 
problems  encountered  pertain  to  the  number  of  variables  and 
to  the  data  set.  The  biggest  problem  was  the  inability  of 
the  CFA  code  to  handle  more  than  20  input /output  variables 
in  any  single  run.  Therefore,  the  original  72  variables  had 
to  be  reduced. 

The  problem  with  the  data  pertained  to  the  range  of 
values  in  a  particular  variable.  If  the  range  was  too 
large,  the  linear  programming  matrix  was  unable  to  produce 
meaningful  results.  Despite  the  scaling  routine  built  into 
the  CFA  program,  the  range  present  in  the  empirical  data  was 
too  great,  and  had  to  be  manipulated  by  other  means  so  the 
data  could  be  used  in  CFA  analysis. 

Another  problem  that  was  introduced  was  the  limitation 
of  computer  time  and  money  to  perform  more  CFA  analysis  on 
the  data  set.  Related  to  this,  there  is  also  the  problem  of 
having  the  CFA  code  on  the  University  of  Texas  at  Austin 
mainframe  computer,  which  is  inaccessable  to  AFIT  students 
unless  TDYs  are  approved. 

The  authors  were  aware  of  these  specific  limitations 
when  conducting  this  research  effort.  Although  these 
limitations  do  not  negate  the  results  of  this  study,  they 
should  be  considered  by  researchers  contemplating  follow-on 


research. 


Recommendations 


This  research  has  shown  that  Constrained  Facet  Analysis 
can  use  empirical  data  collected  for  Air  Force  Fire 
Departments  and  provide  meaningful  results  that  are  useful 
to  fire  protection  managers.  However,  several  issues  must 
be  addressed  prior  to  full  implementation  in  the  Air  Force 
and  are  stated  here  for  further  research. 

1 .  Validate  input  and  output  candidates  as  available 
and  applicable;  then  reduce  the  candidates  statistically 
prior  to  the  use  of  Constrained  Facet  Analysis.  To  obtain 
full  relationships  between  non-profit  organizational  units 
during  Constrained  Facet  Analysis,  empirical  data  that  is 
collected  from  the  field  should  be  complete  and  accurate. 
Missing  data  can  cause  an  important  variable  to  be  left  out 
of  the  variable  list;  therefore,  further  research  should 
consider  the  changes  in  data  collected  by  the  Work 
Information  System  (WIMS)  and  adjust  the  variables  list 
accordingly.  The  data  should  be  statistically  reviewed  not 
only  by  the  Statistical  Package  of  Social  Sciences  (SPSS) 
PEARSON  CORRELATION  subroutine,  but  also  by  SPSS  subroutines 
CONDESCRIPTIVE,  FACTOR  ANALYSIS,  SCATTERGRAM,  and  other 
means  to  successfully  reduce  the  variables  and  to  reduce  the 
range  of  values  in  each  variable. 

2.  Identify  a  more  generalized  data  set.  The  data  set 
should  combine  as  many  variables  as  possible  to  directly  or 
indirectly  capture  all  those  fire  department  characteristics 


that  Fire  Chiefs  and  managers  want  to  analyze  to  improve 
their  efficiencies.  Once  the  data  set  is  determined,  each 
variable  should  be  analyzed  independently  by  qualified  fire 
protection  experts  for  its  usefulness.  Constrained  Facet 
Analysis  is  continually  being  updated  and  future 
redimensioning  of  the  code  to  handle  more  than  20  variables 
at  a  time  will  allow  such  analysis  support. 

3.  Conduct  a  survey  of  Fire  Chiefs  and  other  fire 
protection  managers  to  obtain  acceptance  of  managers  toward 
the  variables  that  will  be  used  to  measure  their  efficiency. 
Additional  research  using  the  Fire  Department  as  the 
decision  making  unit  could  verify  each  variable's 
contribution  to  organizational  efficiency.  Comparisons  of 
several  test  runs,  using  different  input/output  combinations 
could  prove  useful  in  determining  a  standard  set  of 
variables  for  the  fire  department. 

4.  Expand  the  Constrained  Facet  Analysis  code  to 
produce  products  which  provide  the  marginal  rates  of 
substitution  and  marginal  rates  of  productivity  that  will 
aid  the  manager  in  making  performance  improvements,  thus 
improving  organizational  efficiencies. 

5.  Extend  Constrained  Facet  Analysis  into  other 
functional  areas  of  Civil  Engineering.  Current  research 
efforts  are  being  conducted  by  Fisher  (27)  to  determine  the 
efficient  use  of  available  resources  in  the  Operations 
Branch  of  a  base  civil  engineering  organization,  and  by 


Astin  and  Ruff  (5)  to  determine  the  efficiency  of  an 
Engineering  Design  Section  at  a  base  civil  engineering 
organization.  Further  research  into  other  functional  areas 
of  civil  engineering  should  be  attempted.  Once  all 
functional  areas  have  implemented  the  Constrained  Facet 
Analysis  efficiency  model.  Constrained  Facet  Analysis  could 
then  be  used  as  a  model  resulting  in  a  single  efficiency 
rating  for  the  whole  organization.  One  could  take  all  civil 
engineering  functional  areas'  CFA  efficiency  ratings  and  use 
these  ratings  as  inputs  for  the  efficiency  model  of  the 
civil  engineering  organization,  resulting  in  a  single 
efficiency  measure  for  the  organization. 

6.  The  authors  recommend  the  Air  Force  continue  to 
investigate  the  usefulness  of  Constrained  Facet  Analysis. 
This  research  has  shown  that  Constrained  Facet  Analysis  is  a 
management  tool  that  could  be  used  by  Air  Force  Fire 
Departments.  Furthermore,  the  CFA  code  is  continually  being 
improved  and  updated,  and  Air  Force  support  would  accelerate 
the  implementation  of  the  Constrained  Facet  Analysis  model 
as  a  management  tool  for  Air  Force  Civil  Engineering 
organizations . 


Appendix  A:  Fire  Department  Workshop  Participants 


AFESMET  Representatives: 

1 Lt  Michael  A.  Granger 
TSgt  Rod  Haizlip 
GS-11  Larry  Ingrain 
HQ  AFESC  Representatives: 

Capt  John  Bravo 
Capt  Fred  Walker 
MAJCOM  Representaives : 

CMSgt  Donald  G.  Waling 
CMSgt  Chester  E.  Weger 
SMSgt  George  F.  Hall 
MSgt  Larry  D.  Lewis 
GM-13  Hampton  E.  Cayson 
GM-13  Billy  Ferrell 
GM-13  Claude  L.  King 
GM-13  George  Telford 
GS-12  Irvin  R.  Brown,  Jr. 

GS-12  James  W.  Hailey 
GS-12  Benjamin  F.  Palmerton,  III 
GS-12  Jack  Walcott 
GS-11  John  C.  Stokes 


AFESMET /MEMP 
AFESMET/MEME 
AFESMET /MEMP 

HQ  AFESC /DEMG 
HQ  AFESC/DEF 

HQ  USAFE/DEMF 

HQ  AAC/DEMF 

HQ  PACAF/DEMF 

3202  CES/DEF  (AFSC) 

HQ  MAC/DEMF 

HQ  ATC/DEMF 

HQ  SPACECOM/DEP 

HQ  AFSC/DEMF 

1 st  Space  Support 
Group/ DEF 
( SPACECOM ) 

HQ  AFRES/DEMF 

HQ  SAC/DEMF 

HQ  AFLC/DEMF 

325  CES/DEF  (TAC) 
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OPERATIONS 


Structural 

A.  Provide  structural  suppression  capability 

1 .  Command  and  control  at  all  levels  of 
supervision 

a.  Deploy  equipment  and  personnel  at  the 
scene 

b.  Request  and  deploy  mutual  aid  equipment 
and  personnel 

2.  Respond  to  structural  emergencies 

3.  Perform  recurrent  proficiency  training 

4.  Assure  availability  of  portable  equipment 

5.  Conduct  operational  tests  on  ladders  and  other 
equipment 

6.  Develop,  maintain  and  execute  pre-fire  plans 

a.  Perform  on-site  familiarization 

b.  Prepare  pre-fire  plans 

c.  Revise  pre-fire  plans  as  changes  occur  in 
the  facilities 

d.  Use  pre-fire  plans  during  emergency 
responses 

e.  Conduct  exercises  of  facilities  using 
pre-fire  plans 

f.  Review  pre-fire  plans  for  currency 

B.  Provide  wildland  fire  suppression  capability 

1.  Assess  risk:  burnable  material,  terrain, 
weather 


2.  Develop  operations  plans  outlining  procedures 


3.  Respond  to  wildland  fires  and  perforin 
firefighting  operations 

4.  Train  augmentees 

5.  Use  specialized  equipment/tools 

6.  Request/deploy  support  agencies 

7.  Determine  exposures  and  limit  fire  areas  with 
fire  breaks  and  natural  barriers 

8.  Determine  available  water  sources,  manpower 
and  equipment 

9.  Command  and  control — airborne  and  ground 

10.  Develop  and  contract  for  nonfederal  support 

11.  Perform  control  burning 

12.  Determine  fire  protection  requirements  for 
FAM  camps  and  outdoor  recreational  areas 

C.  Provide  rescue  capability 

1 .  Command  and  control 

2.  Assess  requirements,  align  priorities 
(buildings,  cave-in,  automobiles,  aircraft, 
water,  heights) 

3.  Use  specialized  equipment 

4.  Conduct  or  receive  specialized  training 

5.  Respond  to  structural/rescue  emergencies 

6.  Perform  rescue  operations 

7.  Assist  medical  personnel 

D.  Provide  crash  support 

1 .  Respond  to  in-flight  emergencies 

2.  Respond  to  aircraft  ground  emergencies 

3.  Crossman  crash  vehicles 
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4.  Provide  additional  extinguishing  agents  to 
crash  trucks 

5.  Augment  rescue  teams 

6.  Assist  with  interior  aircraft  fire  suppression 
operations 

7.  Assist  reservice  of  crash  trucks 

8.  Assist  in  decontamination 

9.  Neutralize/control/contain  fuel  spills 

10.  Protect  exposures 

Conduct  fire  cause  investigation 

1 .  Investigate  fire 

2 .  Preserve  evidence 

3 .  Determine  cause 

4.  Prepare  reports 

Participate  in  Base  Recovery  Plans  After  Attack 
(BRATT)  exercises 

1 .  Command  and  control 

2.  Responds  to  BRATT  exercises  as  directed 

3.  Comply  with  requirements  of  AFR  93-3 

4.  Develop  fire  protection  requirements  for  BRATT 

5.  Develop  unique  tactical  requirements  for  fire 

fighting/ rescue  in  a  chemical  warfare/UXO 
environment 

6.  Develop  dispersal  plan  for  personnel  and 
equipment 

7.  Develop  communications  systems  locations  -- 
hardened/ semi -hardened 

8.  Assist  with  gross  area  decontamination 

9.  Assist  in  determining  mission  critical 
facilities 


10.  Develop  search  and  rescue  procedures  with 
emphasis  on  self  aid  and  buddy  care 

11.  Prepare  for  fire  fighting  and  rescue  on 
collapsed  or  severely  damaged  facilities 

12.  Determine  method  to  confine  fire  areas  through 
demolition  or  knock  down,  aircraft  removal, 
cover  area 

13.  Determine  feeding/hygiene/sanitation 
requirements 

14.  Receive  and  bed  down  Prime  BEEF  teams 

1 5 .  Employ  Prime  BEEF  teams 

16.  Determine  reserve  equipment  and  personnel 
requirements  ( WRM) 

17.  Host  nation  wartime  support 

18.  Recognize  LIMFACS — resolve  if  possible 

G.  Respond  to  hazardous  materials  incidents 

1 .  Establish  entry  control  point 

2.  Cordinate  efforts  of  disaster  response  force 
until  relieved  by  on-scene  commander 

3.  Assist  in  area  evacuation/rescue 

4.  Determine  appropriate  action  according  to 
hazardous  material  involved 

5.  Put  on  specialized  fire  protection  clothing 
and  equipment 

6.  Determine  proper  agent  and  apply,  as  necessary 

7.  Assist  appropriate  base  agencies  in  actions 
needed  to  isolate,  contain  ,  extinguish,  or 
neutralize  involved  materials 

H.  Contingency  operations/exercises 

1 .  Provide  command  and  control  at  all  levels 

2.  Respond  to  contingency  operation/exercise 
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3.  Terrorist  threats — overt /covert  potential  fire 
areas 

4.  Implement  antihijack  procedures 

5.  Implement  bomb  threat  procedures 

6.  Implement  procedures  to  deploy  vehicles  and 
personnel 

7.  Natural  disasters 
Perform  standby 

1 .  Command  and  control 

2.  Bomb  threats 

3.  In-flight  emergency 

4.  Welding  jobs — hazardous  or  unusual 

5.  Maintenance  activities 

6.  Mutual  aid  cover-in 

7.  R  &  D  hazardous  materials 

8.  Cross  manning  crash  equipment 

9.  Hazardous  materials  incidents 

10.  Dispersal  points  pre-attack 

1 1 .  Stand-by  at  vehicle  accidents 

12.  Others 

Support  fire  prevention 

1 .  Perform  company  inspections 

2.  Conduct  demonstrations,  parades  and  station 
tours 

3.  Assist  in  fire  evacuation  drills 

4.  Assist  in  preschool*  and  school  age  fire 
prevention  programs 

5.  Pass  out  fire  prevention  literature 


6.  Assist  in  babysitters'  emergency  education 
programs 

K.  Support  aircraft  arresting  systems  operations 

1.  Assist  in  removal,  reset,  and  inspection 

2.  Assist  in  disengagement  operations 

3.  Receive  proficiency  training  on  applicable 
systems 

L.  Provide  training  to  ensure  capability 

1 .  Command  and  control 

2.  Assess  and  determine  needs 

3.  Conduct  proficiency  training  IAW  AFR  92-1 

4.  Respond  to  munitions  areas  each  six  months 

5.  Hostile  action  survival  and  sustain  operations 

6.  In-depth  training  on  unique 
facilities /operations 

7.  Local  National  training 
Crash/Rescue 

A.  Provide  aerospace  vehicle  fire  suppression  and 
rescue  capability 

1  .  Respond  to  emergencies 

2.  Provide  command  and  control 

B.  Determine  vehicle  requirements 

1 .  Justify  and  requisition  vehicles 

2.  Establish  and  perform  vehicle  maintenance 

C.  Implement  manning  requirements  for  vehicles  and 
fire  alarm  center 

D.  Establish  and  implement  emergency  response 
requirements  and  procedures 


1 .  Aircraft  fires/crashes  on  base  and  off  base  - 
consider  time  and  distance  factors,  where 
applicable 

Provide  structural  support 

1 .  Use  of  crash  vehicles 

2.  Cross  manning  for  structural  trucks  and 
equipment 

3.  Assist  structural  force  crews 
Perform  standby 

1 .  Perform  abnormal  maintenance  operations 

a.  Green  engine  runs 

b.  Munitions  loading/unloading 

c.  Cutting  and  welding  operations 

d.  Fuel  spills 

e.  Fueling/defueling 

f.  open  fuel  cell  repairs 

g.  Integrated  combat  turns 

h.  Hot-pit  refueling 

i.  Concurrent  refueling  with  passengers  on 
board 

j .  Others  as  required  by  directive 

2.  Aircraft  landings  and  takeoffs 

a.  Mass  (more  than  one) 

b.  Drone 

3.  Auxiliary  field  operations 

4.  Bombing  range  operations 

5.  Medical  evacuations 

6.  Arresting  barriers 


7.  Hydrazine/chemical  spills/leaks 

8.  Special  weapons,  missile  propellents,  and 
other  high  hazard  items,  whether  in  storage  or 
in  transit 

9.  Line  standby 

Conduct  and  receive  firefighter  training  of  mission 
support 

1 .  On  the  job  training 

2.  Proficiency  training 

3.  Specialized  training 

Use  and  maintain  protective  clothing,  breathing 
apparatus,  tools,  equipment,  and  fire  suppression 
agents  necessary  to  ensure  mission  accomplishment 

Develop  and  maintain  a  trained  fire  suppression  and 
rescue  force  capable  of  supporting  the  mission 

Support  fire  prevention 

1.  Conduct  demonstrations,  parades  and  station 
tours 

2.  Pass  out  prevention  literature 

3.  Assist  in  open-house  activities 

Support  aircraft  arresting  system  operations 

1 .  Inspect  and  operate  systems  after  normal  duty 
hours 

Respond  to  hazardous  material  incident 

1 .  Establish  command  and  control 

2.  Perform  rescue 

3.  Controls/abates  hazard 

4.  Plot  grid  location 

5.  Establish  entry  control  point 

6.  Coordinate  efforts  of  disaster  response  force 
until  relieved  by  on-scene  commander 


7.  Assist  in  area  evacuation/rescue 

8.  Determine  appropriate  action  according  to 
hazardous  materials  involved 

9.  Wear  required  fire  protection  clothing  and 
equipment 

10.  Determine  proper  agent  and  apply  as  necessary 

11.  Assist  appropriate  base  agencies  in  actions 
needed  to  isolate,  contain,  extinguish,  or 
neutralize  involved  materials 

12.  Wash  down  fuel  spills  as  necessary 

Contingency  operations/exercises 

1 .  Train,  equip  and  deploy  Prime  BEEF 
firefighting  and  control  teams  for  contingency 
and  exercise  scenarios 

2.  Develop,  train  and  maintain  a  response 
capability  for  contingencies 

a.  Disaster  preparedness 

b.  Garden  plot 

c.  Antihijacks 

d.  Environmental  spills 

e .  BRAAT 

f.  Mobility 

g.  Others 

Develop,  maintain  and  execute  pre-fire  plans 

1 .  Maintain  aircraft  pre-fire  plans  at  the 
following  locations 

a.  Fire  Chief's  vehicle 

b.  Assistant  Fire  Chief's  vehicle 

c.  Communication  center 

d.  Training  reference  library 


e.  Master  technical  order  file 

f.  Rescue  vehicle 

2.  Execute/exercise  aircraft  pre-fire  plans,  as 
required  to  maintain  proficiency,  at  least 
quarterly 

Assist  with  fire  investigation  and  preparation  of 
reports 

Support  BRAAT 

1 .  Provide  firefighting  and  rescue  for  priority 
listed  facilities,  weapons,  systems  and 
equipment 

2.  Assist  with  priority  decontamination  for 
weapon  systems,  facilities  and  equipment 


TECHNICAL  SERVICES 


Conduct  technical  reviews  and  evaluations 

A.  Repair,  renovation  and  construction  projects  (in 
house  and  contract) 

1 .  Review  AF  Forms  332 

2.  Review  AF  Forms  1391 

3.  Review  and  assist  in  preparation  of  project 
booklets 

4.  Review  design  analysis 

5.  Review  project  specifications  and  design 
drawings 

6.  Attend  pre-final  inspections 

7.  Attend  final  inspections 
Conduct  fire  prevention/safety  inspections 

A.  Obtain  and  develop  inspection  folders 

B.  Develop  inspection  schedule 

C.  Review  inspection  documents 

D.  Conduct  inspections,  scheduled  and  unscheduled 

E.  Complete  required  documentation 

F.  Outbrief  building/functional  managers 

G.  Monitor/follow-up  corrective  actions 
Monitor  Fire  Safety  Deficiency  (FSD)  programs 

A.  Identify  deficiencies 

B.  Report  deficiencies  for  correction 

C.  Monitor  programming  action  for  correction 


IV.  Develop  and  conduct  educational  and  training  programs 


A.  Develop  training  aids  and  lesson  plans,  secure 
promotional  materials  to  support  education  and 
training  programs 

B.  Conduct  education  and  training  programs 

1 .  Seasonal  campaigns 

2.  Newly  assigned  people 

3.  Building/functional  managers 

4.  Commanders/supervisors 

5.  Dependent  schools/child  care  centers 

6.  Family  housing 

7.  Special/occupational 

8.  Fire  extinguisher  operation  and  use 

9.  Facility  fire  evacuation 

10.  Fire  prevention  inspection  proficiency 

1 1 .  Contractors 

12.  Social  groups 

13.  Mission  critical  functions 

14.  Others 

V.  Provide  consultant  services 

A.  Project  and  design  engineers 

B.  Base  safety  office 

C.  Commanders  and  supervisors 

D.  Facility  boards 

E.  Safety  council 

F.  Hazard  abatement  council 

G.  Environmental  protection  council 


Develop  and/or  coordinate  directives 

A.  Base  fire  regulations 

B.  Fire  emergency  operating  instructions 

C.  Host  tenant  agreements 

D.  Others 

Administration  of  technical  services 

A.  Develop  and  maintain  documentation 

1 .  Fire  Safety  Deficiencies  (FSD) 

2.  Education  and  training 

3.  Inspections 

4.  Technical  reviews  and  evaluations 

B.  Maintain  publications 

C.  Maintain  technical  reference  library 


MANAGEMENT 


Attends  and  actively  participates  in  base  boards 

A.  Vehicle  authorization  and  utilization  board  (VAUB) 

B.  Facilities  board 

C.  Safety  council 

D.  Working  groups  and  panels 

E.  Environmental  protection  working  group 

F.  Disaster  preparedness 

Prepares,  submits  and  revises  budget 

Directs  internal  fire  department  management  and 
support 

A.  Establishes  and  enforces  standards  of  performance 

B.  Interviews  occupation  (job)  applicants 

C.  Ensures  readiness  of  fire  suppression  capability 

D.  Manages  human,  physical,  real  property  OSSGTS 

E.  Indoctrinates  new  employees 

F.  Responsible  for  provision  of  and  motivation  of 
health,  welfare  and  environmental  conditions 

G.  Established  local  policies/procedures  and 
interfaces  with  union/military  officials 

H.  Participates  in  labor/management  contract 
negotiations 

I.  Promotes  labor/management  relations 

1 .  Union 

2.  Social  actions 

3.  Equal  employment  opportunity 


4 .  Other 


J.  Interprets  and  implements  Air  Force ,  MAJCOM  and 
Wing  policies 

K.  Establishes  and  implemants  a  pre-fire  planning 
program 

L.  Acts  as  final  base  fire  protection  approval 
authority  on  0  &  M,  MCP  project  reviews 

M.  Conducts  supervisory  staff  meetings 

N.  Establishes  and  monitors  departmental  physical 
conditioning  program  and  fitness  of  personnel 

O.  Attends  professional  association  meetings  and 
coordinates  with  other  agencies  to  acquire 
diversified  interface  on  current  fire  protection 
initiatives,  developments  and  states  of  the  art 

Provide  Commanders'  guidance  on  fire  protection  program 

A.  Conducts  staff  meetings 

B.  Advises  commanders  on  current  fire  protection 
problems  and  provides  solutions,  alternatives  and 
courses  of  action 

C.  Apprises  commander  of  fire  incidents,  losses, 
actions,  etc. 

Directs  internal  fire  department  training  programs 

A.  Establishes  and  implements  OJT  program 

B.  Establishes  and  implements  proficiency  training 
program  according  to  mission 

C.  Establishes  and  implements  readiness  training 
program 

D.  Monitors  overall  training  programs 

E.  Encourages  and  promotes  self-improvement  via 
educational  programs 

F.  Conducts  supervisory  training 

G.  Acquires  facilities,  equipment  and  training  aids  to 
accomplish  training  objectives 


.  Initiate  command  and  control  for  base  incidents 

A.  Coordinates,  controls  and  manages  fire  scene 
operations 

B.  Interfaces  with  support  staff  agencies 

C.  Initiates  recall  and  mutual  aid  responses 

D.  Implements  options 

E.  Monitors  fire  scene  to  ensure  safety  of  personnel 
and  equipment 

F.  Initiates  requests  for  investigation  of  suspicious 
fires,  directs  post-fire  operations  to  include 
debriefing  of  firefighters 

Provides  administrative  capability 

A.  Prepares,  monitors,  signs  and  submits  reports 

B.  Establishes  administrative  positions,  functions  and 
assigns  duties 

C.  Drafts,  edits  and  finalizes  correspondence 

D.  Operates  data  processing  equipment 

E.  Establishes,  monitors  and  maintains  data  system 

F.  Operates  (inputs/retrieves  data)  WIMS 

G.  Ensures  maintenance  of  records,  reports, 
publications  and  documentation 

F.  Types  correspondence 
Coordinates  support  agreements 

A.  Determine  the  amount  of  support  needed  for  mutual 
aid 

B.  Develop  interservice  support  agreements 

C.  Support  status  of  forces  agreement 

D.  Support  alliance  agreements 

E.  Develop  memorandum  agreements 

F.  Develop  memorandums  of  understanding 


G.  Develop  host  tenant  agreements 

H.  Develop  joint-use  agreements 

I .  Other 

XI.  General  management 

A.  Prepare  for  strikes  that  affect  host  nations, 
mutual  aid  and  other  agreements 

B.  Assess  possible  contingency  threats 

C.  In  coordination  with  other  agencies,  implement 
plans  to  cope  with  all  probable  contingencies 

XII.  Self  Contained  Breathing  Apparatus  (SCBA)  inspection 
and  maintenance 

A.  Obtain/requisition  required  SCBA 

B.  Obtain/requisition  required  spare  cylinders 

C.  Develop  and  implement  inspection,  test  and 
maintenance  program 

1 .  Perform  operator/user  inspections 

2.  Perform  inspections/maintenance 

3.  Conduct  air  sample 

D.  Operate,  maintain  and  reservice  equipment 

1 .  Compressor/purifier 

2 .  Cascade 

E.  Document  inspection,  test  and  maintenance  records 

F.  Conduct  and  receive  training  for  maintenance 

XIII.  Accomplish  fire  extinguisher  maintenance 

A.  Determine  fire  extinguisher  requirements 

B.  Obtain  and  distribute  extinguishers 

C.  Establish  a  scheduled  inspection,  testing  and 
maintenance  program 


1.  Perform  scheduled  maintenance,  inspection  and 
testing  IAW  NFPA  10,  AF  TO's  and  AFOSH 
standards 

2.  Provide  facility  and  equipment  to  perform  the 
maintenance 

3.  Coordinate  bench  stock/shop  stock  to  perform 
maintenance 

D.  Perform  unscheduled  repair,  reservicing  and 
maintenance 

E.  Redistribute  repaired,  reserviced,  wheeled 
extinguishers 

F.  Support  fire  prevention  training  and  educational 
programs 

G.  Perform  operator's  care  and  maintenance  of  assigned 
vehicle 

H.  Maintain  assigned  facility 
XIV.  Logistics  support  (Supply) 

A.  Identify  resource  requirements 

B.  Prepare  and  process  logistic  requests 

C.  Conduct  follow-up  action  on  supply  documents 

D.  Review  and  update  CA/CRL 

E.  Maintain  physical  inventory 

F.  Maintain  supply  discipline 

G.  Establish  and  maintain  stock  levels 
(bench/ shop/special ) 

H.  Maintain  reference  library 

I.  Conducts  internal  training/supply  discipline 

J.  Ensures  compliance  with  Federal  specifications 

K.  Perform  data  search 

L.  Evaluate  serviceability  of  protective  clothing  and 
support  equipment 
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M.  Coordinates  repair/maintenance  for  equipment 

N.  Assists  in  preparing  budget 

O.  Picks  up,  receives  receipts,  delivers,  turns  in  and 
issures  resources 

P.  Attends  supply  custodian  courses 

Q.  Performs  supply  liaison  with  applicable  agencies 

R.  Provides  essential  logistic  support  functions 
during  emergencies  (SCBA,  reservicing,  clothing, 
agent,  etc.) 

S.  Assists  in  preparation  of  Material  Deficiency 
Reports  (MDR's),  reports  of  survey  and  Quality 
Deficiency  Reports  (QDR's)  as  required 

Logistics  support  (Vehicles) 

A.  Identify  vehicle  discrepancies  using  applicable 
technical  orders  and  supplemental  checklists 

B.  Reports  discrepancies  to  LGT 

C.  Maintains  awareness  of  LGT  special  levels/bench 
stock/parts  requisition 

D.  Conducts  follow-up  actions  to  ensure  correct 
FAD/priority  is  assigned  to  requisition 

E.  Uses  and  conducts  technical  order  research 

F.  Coordinates  scheduled  maintenance 

G.  Conducts  and  documents  vehicle  tests 

H.  Maintains  technical  order  reference  library 

I.  Ensures  vehicle  serviceability/reliability 

J.  Conducts  vehicle  operations  training 

K.  Attends  VAUB  meetings 

L.  Prepares  and  submits  AF  Forms  1374  and  601 
Alarm  communications  operations 

A.  Establish  a  primary/alternate  fire  alarm 
communications  center 


1 .  Staff  with  qualified  operators  to  perforin  a  24 
hour  service 

2.  Operate  alarm  receiving  and  recording 
equipment,  data  storage  and  retrieval  system, 
computer  aided  dispatch  system,  communications 
equipment,  etc. 

Use  written  operating  instructions/procedures  for 
alarm  receipt,  dispatch  and  notification  of  support 
agencies,  operation  of  alarm  equipment,  standby 
requirements,  etc. 

Use  and  maintain  maps,  charts,  graphs,  logs  and 
reference  library 

Research  data  and  relay  information  to  senior  fire 
official 

Receive  incoming  communications  and  relay  to 
appropriate  authority;  notify,  dispatch  and 
coordinate  emergency,  exercise,  contingency 
responses 

Conduct  and/or  receive  training 

Provide  information  for  the  consolidation  and 
preparation  of  records  and  reports 

Perform  housekeeping  tasks 

Perform  BCE  service  call  function  after  duty  hours 
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The  capabilities  and  properties  of  Constrained  Facet 
Analysis  ( CFA)  now  will  be  demonstated  by  performing  a  CFA 
evaluation  of  four  single  output,  two  input  data  points. 
Suppose  organizational  units  A,  B,  C  and  0  shown  in  Table 
D. 1  each  produced  the  same  two  types  of  resources,  Xi  and 
X2,  during  some  specified  time  period.  Table  D.1  provides 
the  amounts  of  outputs  produced  and  inputs  consumed  by  units 
A  through  D  during  the  production  process. 

TABLE  D.1 


Input  and  Output  Values  for  Organization  A  through  D 


Organizational 

Units 

*1 

Inputs 

*2 

Output 

Y 

A 

5 

7 

1 

B 

4 

4 

1 

C 

5 

2 

1 

D 

6 

4 

1 

Figure  D.1  is  the  geometric  representation  of  the 
data  in  Table  D.1.  Because  each  unit  produces  the  same 
amount  of  output,  Y  =  1  ,  the  linear  frontier  segment  in 
Figure  D.1  connecting  units  B  and  C  is  efficient  relative  to 
the  remaining  units  A  and  D  regardless  of  the  relative 


"weights”  or  "costs"  of  inputs  Xi  and  X2*  In  fact,  if  pi  is 
the  cost  of  Xt  and  if  P2  is  the  cost  of  X2,  then  C  is 
preferred  to  or  more  efficient  than  A,  B  and  D  when  pi  2. 

2p2?  B  is  preferred  when  1/2p2  <.  p-j  <.  2p2?  and  C,  when  p-j  ± 
1/2p2. 

Because  the  ray  from  the  origin  to  point  D  (Figure  D.1) 
crosses  the  linear  frontier  segment  BC,  this  unit  is  "fully 
enveloped"  by  the  frontier,  and  only  one  iteration  of  CFA  is 
required  to  evaluate  it.  Unit  A,  on  the  other  hand,  is  an 
"outlier"  in  the  sense  that  ray  OA  does  not  cross  frontier 
segment  BC. 

One  might  believe  that  full  envelopment  is  a  common 
occurance  even  in  multiple  input,  multiple  output 
situations.  In  actual  practice,  full  envelopment  rarely 
occurs  in  multiple  input /output  analyses.  In  all  field 
implementations  or  demonstations  of  CFA  known  to  the 
authors,  a  lack  of  full  envelopment  is  the  rule  rather  than 
the  exception.  In  fact,  during  an  evaluation  of  Texas 
schools  in  1983,  about  60%  of  the  schools  evaluated  were 
inefficient  (over  300  inefficient  ratings),  and  all  of 
these  inefficient  schools  were  not  fully  enveloped  (20). 

Constrained  Facet  Analysis  was  developed  to  handle  the 
numerous  situations  in  which  units  are  not  fully  enveloped. 
Therefore,  the  discussion  that  follows  will  focus  primarily 
on  the  CFA  evaluation  of  unit  A  which  is  the  only  not  fully 
enveloped  unit  in  this  example. 


Constrained  Facet  Analysis  of  Unit  A 


The  primal  model  of  CFA  for  unit  A  at  iteration  one  is 

PRIMAL 

Maximize:  fA^  “  MA^  +  +  7V2A^  (1 

Subject  to:  UAd)  “  sVlA^^  ”  7'>2A^  <  0 

yA(1)  -  4V1A(1)  -  4V2A(l)  <  0 
yA(1)  -  5ViA(1)  -  2v2a(1)  <  0 
UA(1)  ~  6v1A(1)  "  4V2A(1>  <  0 
5V1a(D  +  7V2a<D  <  ! 

gA(1)  >  o  i»iA(1)  >  o  v2A(1)  >  o 

m 

The  dual  formulation  of  this  model  is: 

DUAL 


Minimize: 

9A(1) 

(2) 

Subject  to: 

6a(1) 

♦  6bU)  -  6c(1)  +  «D<1>  - 

SA(l)  -  1 

59a(1) 

-  56a(1) 

-  46b(1)  -  S*c™  -  6D(l> 

-  s1A(1)  * 

5 

79a(1) 

-  *A(l) 

-  46b(1)  -  2«C<1>  -  60<D 

-  S2A(1)  * 

7 

«A(1), 

V1}, 

«c(1),  «Dd)  >  0 

sA(1). 

SlA(1). 

S2A(1)  >  0 

9aU) 

unrestricted  in  sign 

The  optimal  solutions  of  models  (1)  and  (2)  yield: 

UA(1)*  *  4/5  V1A(1)*  =  1/5  V2A(1)*  =  0 

fA(1)*  *  9A(1)*  -  4/5  ♦  1  -  9/5 


The  upper  bound  efficiency  measure  is  hAu*  =  gAn  )*  -  1 
*  =  4/5.  To  achieve  this  high  rating,  the  model 

compared  unit  A  to  unit  B  only  (<5b^*  =  1)  and  input  X2  was 
ignored  or  given  zero  value  in  the  analysis  (V2A^*  =  0  and 
S2a^*  *  8/5).  Because  S2A^*  *  8/5,  a  second  iteration 
of  CFA  is  required  to  bring  another  vector  of  inputs  on  the 
frontier  into  the  basis  to  replace  the  slack  vector.  The 
primal  and  dual  formulations  of  the  second  iteration  are: 


1 


PRIMAL 


Maximize: 

fA(2) 

Subject  to: 

ua(2) 

ua<2) 

Wa(2) 

Ua(2) 

=  HS2A(1)’ 

*v2a(2)  -  (a/^v2A 

-  5V1A<2>  - 

7V2a(2) 

<  0 

-  4V1a<2)  - 

4V2A<2> 

=  0 

-  5V1a(2J  - 

2v2A(2) 

<  0 

-  6V1A(2)  - 

4V2A(2) 

<  0 

5V1A(2)  + 

7V2a(2) 

=  1 

DUAL 

Minimize: 


W2) 

W2) 


«Sa(2)  +  xb<2>  +  6c(2> 

5<V2)  -  4*B(2)  -  5<5C(2) 

7<5A<2)  -  4Xb(2)  -  26c<2> 


(4) 

6d(2) 

-  sA(2)  =  0 

66d(2) 

-  a1Ac2)-  0 

46d(2) 

-  S2a(2)=  8/5 

<5a<2>,  <5c(2)  »  <5d(2)>0 

SA(2>»  S1a(2),  s2a(2)  >  0 

gA^2^,  Ag(2^  unrestricted  in  sign 


Subject  to: 


The  optimal  solutions  of  (3)  and  (4)  yield: 

fA(2)*  =  -  3A(2)*  -  8/85 

Ua(2)*  =  12/17  V]^2**  =  2/17  V2a(2)*  =  I/*7 

6C<2>*  =  -8/17  6A<2>*  =  6D<2>*  =  0  Xb<2>*  »  -8/17 

SA(2)*  "  SlA(2)*  -  S2A^)‘  =  0 


The  lower  bound  efficiency  measure  is  hAL*  =  UA(2)*  = 
12/17.  Note  also  that  hAu*  -  hAL*  =  UA(1)*  -  Uft(2)*  =  4/5 

-  12/17  =  8/85  =  fA(2)*  =  gA(2)*  .  Thus,  the  optimal  value 
of  the  objective  function  for  iteration  two,  f  A(2^*  ,  is  the 
amount  of  decrease  in  the  efficiency  rating  which  occurs 
when  unit  A's  efficiency  is  measured  relative  to  unit  B  and 
C  instead  of  unit  B  alone.  This  can  be  shown  mathematically 
as  follows. 

Let  L  and  U  be  vectors  from  the  origin  0  to  points  L 
and  U  in  Figure  D.l.  The  upper  bound  efficiency  measure, 
hAu* ,  is  the  length  of  the  vector  U  divided  by  the  length  of 
vector  A;  or,  in  other  words: 


Similarily , 


°u 

OA 

=  UA(1) 

|o|lo 

II 

CM 

> 

n 

Furthermore,  the  following  equality  holds  optimality  of 
iteration  one: 


(1)*=  iA  , 


g 


And,  from  the  dual  of  iteration  two: 


SA{1>*  =  gA<2>*A  -<SC(2>*C  -  ^<2)*!  (6) 

Together,  (5)  and  (6)  imply 

UA(1)*A  -  6b(D*B  =  gA<2)*S  -  6c(2)*c  -  Xb(2)*b  (7) 

Collecting  like  terms  in  (7),  one  obtairs: 

UA(1)*A  -  gA(2)*A  =  6c(2)*c  +  6b(D*b  -  V2>*5 

-  (0  -  6C(2)*)C  +  (6b(D*  -  ^(2)*)! 

=  (6C(D*  -  6C<2)*)C  +  (6b(D*  -  Ab(2)M  (8) 

The  optimal  dual  solutions  of  iterations  one  and  two  also 
yield: 

(0  -  Sc(2>*  )  +  (  6B(1)*  -  Ab(2)*  ) 

=  (0  -  8/17)  +  [(1  -  (-8/17)] 
=1+8/17-8/17*1.  (9) 

Equality  (8)  shows  that  the  vector  yA(1)*  A  -  gA(2)*A  is 
a  linear  combination  of  vectors  B  and  C.  According  to 
equality  (9),  this  vector,  which  extends  from  the  origin 
along  A,  terminates  at  a  point  on  the  line  passing  through 
both  points  B  and  C.  Thus, 


By  definition. 


0  =  VA^*H  =  hAU*A,  (11 

and 

L  =  UA(2)*A  =  hAL*A.  (12 

Combining  (10),  (11)  and  (12)  yields: 

U  -  L  =  (hAu*  -  hAL*)A  =  gA(2)*  A. 

Hence , 

UAU)*  -  UA(2)*  -  hAU*  -  hAL*  =  9a<2)*  ;  Or/ 

in  other  words,  the  decrease  in  efficiency,  hAu*  -  hAL*  , 
equals  the  value  of  the  objective  function,  gA(2)*  ,  at 
optimality  of  the  second  iteration. 

Figure  D.2  and  D.3  provide  a  geometric  interpretation 
of  this  proof.  In  Figure  D.2,  the  vector  L  is  shown  as  a 
linear  combination  of  vectors  B  and  C.  Figure  D.3 
demonstrates  how  the  surplus  vector  (0,S2a(1)*  )t  ^as  been 
replaced  in  the  second  iteration  of  CFA  by  the  vectors  (hAu 
-  hAL*)A  and  -6C(2)*C  -  AB(2)*  B. 

Upper  and  Lower  Bound  Efficiency  Measures 

The  upper  and  lower  bound  efficiency  measures  for  each 
unit  A,  B,  C  and  D  are  shown  in  Table  D.2.  Since  units  B 
and  C  are  on  the  frontier  and  since  unit  D  is  a  fully 
enveloped  inefficient  unit,  the  upper  and  lower  bound 
efficiency  measures  for  these  units  are  the  same.  The  not 
fully  enveloped  unit  A  was  the  only  unit  which  required  a 


second  iteration  and  therefore  received  a  reduction  in  its 


efficiency  rating. 


TABLE  0.2 

Upper  and  Lower  Bound  Efficiency  Measures 
for  Units  A  through  D 


Organizational 
Unit 1 s 


A 

B 

C 

D 


Efficiency 
Upper  Bound 
( h  jU  ) 


.8000 
1  .0000 
1 .0000 
.7500 


Measures 

Lower  Bound 
(h  jL* ) 

.7059 
1 .0000 
1 .0000 
.7500 


Frontier  Facets 

Table  D. 3  displays  the  frontier  facets  used  as  criteria 
for  measuring  the  relative  efficiency  of  each  of  the  units. 
Also  provided  are  the  associated  multipliers  for  each 
iteration  and  any  alternative  optima.  Note  that  sets  of 
nonzero  multipliers  were  obtained  from  iteration  one  for  all 
units  except  A.  Unit  A  had  one  zero  multiplier,  v2j(1)*  =  0, 

and  one  surplus  value,  S2A(1)*  =  8/5,  at  optimality  of  the 
first  iteration.  During  iteration  two,  the  frontier 
reference  for  evaluation  of  A  changed  from  the  "artificial" 
facet  3M2  to  the  proper  facet  BC,  and  nonzero  multipliers 
were  generated  as  a  result  of  this  change. 

The  efficiency  measures  and  multipliers  provided  by  CFA 
for  unit  D  can  be  used  to  evaluate  the  marginal  rates  of 


Frontier  Facets  for  Units  A  through  D  and  Associated  Values  of  Multipliers 
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The  first  iteration  was  the  last  for  units  Bf  C,  and  D 


substitution  and  marginal  rates  of  productivity  in  the 
frontier  facet  BC. 

i 

Marginal  Rates  of  Substitution  and  Productivity 

According  to  Clark  ( 20 ) ,  the  marginal  rates  of 
substitution  between  inputs  Xi  and  X2  in  BC  can  be  computed 
as  follows: 


3X2  \ 

1/8 

3*1/ 

BC  V2D(1)* 

1/16 

-2 


The  marginal  rates  of  productivity  associated  with  this 
facet  can  also  be  obtained  as  follows: 


and 


3y  > 

VlD(1)* 

1/8 

3*i  i 

^  BC 

‘  yD(1)* 

3/4 

3y  ^ 

V2D(1)* 

1/6 

ax2  j 

^  5c 

3/4 

1/6, 


1/12. 


These  rates  of  substitution  and  productivity  can  be 
used  to  investigate  alternative  efficient  combinations  of 
outputs  and  inputs  which  might  improve  productivity. 

Values  if  Efficient 

Managers  of  inefficient  units  would  like  to  know  which 


changes  in  inputs  or  outputs  would  lead  to  an  efficient 
rating.  There  are  an  infinite  number  of  alternative 


input /output  combinations  which  an  inefficient  unit  could 
adopt  to  achieve  the  frontier  of  relative  efficiency.  These 
alternatives  can  be  obtained  from  the  optimal  solutions  of 
constrained  facet  analysis.  Four  alternative  projections  of 
values  if  efficient  are  given  below  for  unit  A. 

One  way  for  A  to  achieve  an  efficient  rating  would  be 
to  reduce  its  input  vector  by  multiplying  it  by  the  upper 
bound  efficiency,  hAu*  =  4/5,  and  then  subtracting  the 
surplus  vector,  "sA(1)  •  which  would  yield: 


In  other  words,  A  could  achieve  an  efficient  rating  by 
lowering  its  inputs  to  the  levels  of  B  while  maintaining  its 
output  at  the  same  level  *  1 . 

Or,  unit  D  might  wish  to  adjust  its  output  upward  to  a 
value  of  (1/hAu*  )  =  5/4  and  adjust  its  inputs  as  follows: 


Other  alternative  values  if  efficient  can  be  obtained 
from  the  second  (final)  iteration  of  CFA.  Unit  A  would  be 
rated  efficient  relative  to  facet  BC  if  YA  =  1  and  if  the 
input  amounts  X 1A  and  X2A  could  be  reduced  to: 


An  efficient  rating  could  also  be  achieved  if  the 


inputs  Xia  and  X2A  were  held  constant,  and  if  the  output 
could  be  changed  to: 


Table  D.4  shows  the  alternatives  discussed  above  plus 
one  other  which  demonstrates  the  fact  that  there  are  an 
infinite  number  of  other  possibilities.  Alternative  five  in 
Table  D.4  was  obtained  by  using  the  lower  bound  efficiency 
measure  and  the  marginal  rate  of  substitution  between  inputs 
Xi  and  X2  in  the  proper  facet  BC  which  is  nearest  to  A.  For 
this  alternative,  the  adjusted  value  of  input  one,  X'1A  ,  is 
allowed  to  vary  in  the  range: 


(X2c)(1/hAIj*  )  *  34/12  £  X'2A  £  7  •  X2A 


where  (X2c/hAL*  )  is  the  smallest  value  X*2a  can  assume  and 
retain  BC  as  its  reference  given  that  X'ia  is  forced  to 
trade-off  with  X'2a  according  to  the  following: 


X’lA  "  X1A  +  —  —  (X'2A  -  7> 

\  ?x2  J  BC 

(  -2A(2)*  \ 

=  XlA  =  (x'2a'7) 


=  X1A  -  '  7) 

*  5  -  1/2 (X ' 2A  -  7>* 


Appendix  E:  Model  Used  in  Constrained  Facet  Analysis 

of  Not  Fully  Enveloped  Units 


The  model  used  in  the  iterative  method  called 
constrained  facet  analysis  is  presented  in  this  appendix,  a 
model  which  can  be  used  in  evaluating  the  range  of 
inefficiency  in  organizational  units  and  in  determining 
marginal  rates  of  substitution  and  productivity  in  frontier 
facets. 

Suppose  one  wishes  to  evaluate  the  relative  efficiency 
of  n  decision  making  units  (DMUs),  each  of  which  uses 
varying  amounts  of  m  inputs  and  produces  varying  amounts  of 
s  outputs.  Using  notation  conventions  similar  to  those  used 
by  Clark  (20)  let: 


Xij  a  the  amount  of  input  type  i  used  by  DMU  j  during 
the  period  of  observation,  i  =  1,  2,...,m  and 
j  *  1,  2 , . . . ,n. 


=  the  amount  of  output  type  r  produced  by  DMU  j 
during  the  period  of  observation, 
r  a  1 ,  2 , . . . , s  a nd  j  a  1  ,  2,...,n. 


xik  *  the  amount  of  input  type  i  used  by  the  unit  k 
where  k  j  —  1,  2,...,k,.«.,n  and  unit  k  is 

the  DMU  being  evaluated.  Each  DMU  in  turn  will 
be  evaluated. 


yrk  =  the  amount  of  output  type  r  used  by  DMU^. 


N  =  1 ,  2 ,  3 , . . . ,M  is  the  sequence  of  iterations  of 

the  constrained  facet  analysis  model  which  ends 
at  iteration  M. 
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hfc'  1  =  the  upper  bound  efficiency  value  sought  for  DMUfc 
which  is  determined  from  the  solution  of  the 
first  iteration  of  the  constrained  facet 
analysis. 1 

hk^M^  *  the  lower  bound  efficiency  value  sought  for  DMU^ 
which  is  determined  from  the  solution  of  the 
final  iteration  (M)  of  the  constrained  facet 
analysis . 

ViA">  =  the  multipliers  for  each  input  type  i  which 
will  be  determined  by  solution  of  the  Nth 
iterative  model. 

UrAN^  =  the  multipliers  for  each  output  type  r  which 
will  be  determined  by  solution  of  the  Nth 
iterative  model. 


sr£N-1 )  -  the  dual  surplus  values  associated  with  outputs 
r  *  1,  2,...,s  of  DMUfc  at  optimality  of  the 
previous  iteration.  For  the  initial  iteration, 

these  surplus  values  are  srk^0^* 

*  Yrk- 

)*=  the  dual  surplus  values  associated  with  inputs 
i  =  1 ,  2 , . . . ,m  at  optimality  of  the  previous 
iteration.  Initial  values  at  iteration  one  are 
sik<N-1)*  =  sik«>>*  =  xik. 


The  form  of  the  constrained  facet  analysis  model  used  in 
the  first  iteration  is  similar  to  the  Data  Envelopment 
Analysis  (DEA)  model  of  Charnes,  Cooper  and  Rhodes  (19); 
however  the  non -Archimedean  infinitesimal  quantities  are 
not  required. 


The  following  linear  programming  model  is  used  in 


constrained  facet  analysis  for  each  iteration 
N  =  1 ,  2, _ M: 

Primal 


«ax  fk<»>  -  I  urk‘»>3rk<»-l>*  ♦  I  vik(N)SlkIN-»* 


r»l 

s 


i»l 


m 


s.t. 


I  Urk(N,Yrj  "  I  vik(N)xij  =  0  for  j£Ek<N) 
r=l  i*l 


m 


l  Wrk(N)Yrj  ~  l  vik(N)xij  ±  0  f°rjeEk<N> 


r=l 


i=l 


m 


I  vik<N)*ik  =  1 


i=l 


^rk<N).  vik(N)  >  0 


where 

-  tj/jth  constraint  holds  with  equality  at 
optimality  at  iteration  N-1 } 

Ek(N)  =  {j/jth  constraint  is  <  0  at  optimality  of 
iteration  N-1 } 

Ek^)  =  4)  (empty),  E]^1  )  =  {1,  2,...,n}. 


The  upper  and  lower  bound  efficiency  measures  are 
obtained  from  solution  of  the  first  and  last  iterative 


The  mathematical  theory  and  proofs  related  to  the 
development  of  this  model  can  be  found  in  Clark  (20).  They 
will  not  be  repeated  in  this  paper,  but  there  are  a  few 
model  characteristics  which  are  worth  noting  here. 

First,  the  efficiency  measures  h^^1^  and  h)^M)  are 
scalar  ratio  measures.  Secondly,  the  constraints  of  the 
primal  problem  insure  that  the  maximum  achievable  value  of 
these  efficiency  measures  is  1.  Furthermore,  constrained 
facet  analysis  does  not  require  that  outputs  or  inputs  have 
common  scales  or  units  of  measurement,  an  important 
attribute  when  dealing  with  difficulties  such  as  nonmonetary 
objectives  and  nonpurchased  resources,  however;  all  measured 
input  and  output  values  are  required  to  be  strictly 
positive.  Finally,  each  unit  is  compared  to  others  in  the 
set  which  have  similar  input/output  mixes,  i.e.,  those  units 
in  its  "neighborhood". 

In  short,  the  constrained  facet  analysis  model  can 
identify  units  which  are  efficient  or  inefficient  relative 
to  a  neighborhood  frontier  region  of  actual  achievement;  it 
can  provide  a  limited  number  of  clues  on  possible  causes 
from  analysis  of  surplus  variables  and  multipliers;  and  it 
is  helpful  in  evaluating  the  impact  of  alternative  mixes  of 
inputs  and  outputs. 

Furthermore,  the  information  provided  by  the 
constrained  facet  analysis  model  is  a  major  improvement  over 
the  inadequate,  partial  (and  sometimes  inaccurate)  measures 
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of  performance  which  are  now  typically  in  use  in  many  public 
service  organizations.  In  addition  to  its  usefulness  as  a 
performance  monitoring  device,  this  efficiency  analysis  tool 
opens  the  door  for  further  development  and  growth  in  other 
areas  of  planning,  resource  allocation  and  decision  support. 


Reprinted  from: 


"Constrained  Facet  Analysis,  A  New 
Method  for  Evaluating  Local  Frontiers 
of  Efficiency  and  Performance"  (11) 


Appendix  F :  AFESC  Data  Collection  Package 

to  Major  Commands 


DEPARTMENT  OF  THE  AIR  FORCE 

MCAOOUAffTEM  AM  WCI  IMMdRMQ  AMO  MRVtCCE  CtWTfO 
TTMOAU.  AM  FOMCI  AAM.  Ft  . 


DBM 


Data  Collection  for  Fire  Department  project 


10  A PRo*, 


HQ  APCC/D8F 
HQ  AU/D8F 
HQ  SAC /DBF 
HQ  USAFA/DBP 


HQ  AFLC/DBF  HQ  ATC/DBF 
HQ  AFSC/D8P  HQ  MAC/D8P 
HQ  SPACSCOH/DBF  HQ  T  AC/ DBF 
HQ  APRES/DBP 


1.  One  of  the  requirements  of  Project  IHAOB  is  to  develop  e  method  to 
measure  productivity  (efficiency/effectiveness)  for  each  Civil  Engineering 
function.  The  task  of  measurement  for  the  Fire  Department  has  been 
undertaken  as  a  Masters  Degree  thesis  project  by  two  students  at  the  Air 
Force  Institute  of  Technology.  This  function  promises  to  be  the  most 
difficult  to  evaluate  because  of  its  total  service  mission. 


2.  Major  Susanne  M.  Waylett  and  1st  Lieutenant  Timothy  A.  Byers  are  using 
a  new  methodology  developed  at  the  University  of  Texas  called  Constrained 
Facet  Analysis  which  is  the  only  system  that  has  the  ability  to  produce  an 
evaluation  using  multiple  inputs  and  multiple  outputs.  They  have 
identified  the  data  elements  listed  on  the  attached  form  as  those  needed 
for  the  system. 

3.  Request  that  you  collect  this  data  for  FT  83  from  each  CONUS  base  In 
your  command,  not  Including  those  Fire  Departments  that  are  contracted, 
and  return  to  HQ  APSSC/DBMQ  by  23  April  1984.  Considerable  effort  was 
expended  to  develop  a  set  of  Instructions  that  fully  explains  each  element 
and  the  source  document  for  the  data.  Organizations  should  be  reminded  to 
carefully  read  the  instructions  prior  to  filling  out  the  data  form. 
Questions  concerning  the  data  request  may  be  directed  to  Major  Waylett  or 
Lt  Byers  by  leaving  a  message  at  AUTOVON  785-4437. 


FOR  THE  CQtMANDSR 


Direct/r.  Operations  and 

maintenance 


1  Atch 

Data  Request  Form  w/atch 


Usa  the  following  Instructions  to  fill  out  data  request  fora.  All  data  aust 
be  for  Fiscal  year  83  (not  calendar  year).  Put  N/A  where  data  not  available. 
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Appendix  H:  CFA  Productivity  Assessment  Symposium  Participants 


Jared  Astin 

Masters  Candidate 

Air  Force  Institute  of  Technology 

Authella  M.  Bessent 
Associate  Professor  of 

Operations  Research 
The  University  of  Texas 

E.  Wailand  Bessent 
Professsor  of  Educational 
Administration 
The  University  of  Texas 

Timothy  A.  Byers 

Masters  Candidate 

Air  Force  Institute  of  Technology 


C.  Terry  Clark 
Assistant  Professor  of 

Operations  Research 
Air  Force  Institute  of  Technology 

Rick  Clarke 

PhD  Candidate 

General  Business 

The  University  of  Texas  ■ 

Gary  Delaney 
PhD  Candidate 
Management 

The  University  of  Texas 

Jo  Ann  Duffy 
PhD  Candidate 
Management 

The  University  of  Texas 
Joyce  Elam 

Associate  Professor  of 

Information  Systems 
The  University  of  Texas 

Marvin  Fisher 

Masters  Candidate 

Air  Force  Institute  of  Technology 


James  A.  Fitzsimmons 
Professor  of  Management 
The  University  of  Texas 

Warren  Garrett 
PhD  Candidate 

Educational  Administration 
The  University  of  Texas 

Valerie  Gonnerman 
Masters  Candidate 
Air  Force  Institute  of  Technology 


Michael  Katims 
PhD  Candidate 

Educational  Administration 
The  University  of  Texas 

Roger  Parks 

Associate  Professor  of  Public 
and  Environmental  Affairs 
Indiana  University 

Linda  Reaves 
Associate  Professor  of 

Educational  Administration 
University  of  Houston 

Robert  Schneider 
PhD  Candidate 
General  Business 
University  of  Arizona 

Christopher  Ruff 

Masters  Candidate 

Air  Force  Institute  of  Technology 

Jim  Thomas 
PhD  Candidate 
Management 

The  University  of  Texas 

Sue  Waylett 

Masters  Candidate 

Air  Force  Institute  of  Technology 
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Appendix  I :  Final  Data  Set  for  Constrained  Facet  Analysis 
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Appendix  J:  Comparative  Facet  Tables 
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Due  to  a  CFA  code  idiosyncracy,  this  unit  appears  in  both  the  efficient  and  inefficient  sets. 


Inefficient  Units 


TABLE  J.3 


Number  of  Appearances  of  Each  Efficient  DHU  in  the  Facet  of  an  Inefficient  ONU  (Test  #5) 


1 
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15 
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41 
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46 
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58 
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61 
62 
64 
70 
72 


3  4 


Efficient  Units 

9  10  11  12  21  23  36  38  40  44  45  47  53  S4  57  60  63  65  66  67  69  71  73  16* 
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X 
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X 

X 

X 

X 

X 
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X  X 


X  X 


X 

X 


Total  17  27  2  19  0  10  11  0  20  2  12  7  7  9  26  4  10  3  3  0  12  0  26  24  3  24  18  2 


Due  to  a  CFA  code  idiosyncracy  this  unit  appears 
in  both  the  efficient  and  inefficient  sets 


Appendix  K:  Constrained  Facet  Analysis  Summary  File 
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3335.000 

*6500.000623606.000 

1100.000 

7002  C0**0 

.000374 

.003322 

.000010 

.003026 

.000900 

.000003 

.000000 

700200*40 

0 

a 

0 

0 

0 

0 

0 

700200*40 

3.0002235*3.000 

10.030 

20.000 

2.000 

33.000 

700  2  CO  *40 

.000030 

•  0C90O3 

.300010 

.013634 

.000030 

.000030 

700200*40 

0 

0 

0 

9 

0 

0 

70C3C0  430 

3.00000  3 

.00000 

700300*90 

233  .0  00 

29.000 

492.303 

1096.009 

400.000 

7388.000 

*3*6.000 

700300*30 

.00  0233 

.000003 

.000343 

.090000 

.000000 

.000003 

.000003 

700  3  00  *30 

0 

0 

3 

3 

0 

0 

0 

700300  430 

2.000 

6*730.000 

5.000 

29.000 

14.000 

*.000 

700300*90 

.367763 

.000006 

.0  70  770 

'  .0  9*0  35 

.300030 

.000010 

700  3  00  *30 

0 

0 

0 

m 

0 

0 

700200*40 

3.00000  1 

.00000 

709  200*60 

623.000 

26  39.000 

3937.000 

16*4.000 

3**40.000 

1S0X9.090 

9*06.000 

700200*60 

.00  03(0 

.000  323 

.309130 

.000003 

.OCOOOO 

.000003 

.000003 

703  200*69 

0 

0 

0 

A 

0 

0 

0 

700200*60 

3.0303  30392.300 

30.000 

23.000 

22.300 

72.030 

700  200*60 

.00  0010 

.000090 

.000030 

.034366 

.000030 

.008634 

70C2C0  460 

0 

0 

9 

0 

0 

0 

700  200*70 

1.00000  1 

.00000 

700200*70 

323.030 

1019. COO 

1434.000 

1666.000 

24233.000 

32630.000 

8413.000 

7  0  0  2  00  *  70 

.30  0030 

.0000*7 

.3091*3 

.000000 

•  cocao  i 

.000  00  2 

.000003 

700  200*70 

3 

0 

1 

0 

0 

0 

0 

700200*70 

2.000 

63209.000 

33.100 

26.00: 

23.000 

13.000 

700200*70 

.32  2640 

.000007 

.033  736 

.00**63 

.3037*6 

.000330 

700  200*70 

0 

0 

9 

9 

0 

0 

700*03*00 

.666 •• 

.6664* 

700*03*40 

673.030 

139.000 

1*93.300 

2314.003 

20444.300 

*371.000 

6307.000 

700*00*90 

.00  0336 

.099001 

.000233 

.0  3002* 

.000301 

.00000  3 

.00000* 

700*00**0 

0 

0 

0 

9 

0 

0 

0 

700*00*80 

3 .000330034.000 

9.330 

37.009 

30.000 

12.000 

7  0  0  4  00  *00 

.03  77*7 

.000000 

.036343 

.000377 

.00*20* 

.0*3*37 

700*00  440 

0 

a 

0 

9 

a 

0 

700200*40 

.39317 

.7**38 

700  200**0 

3  44  .0  0  0 

460.080 

2*09.000 

1331.000 

77631.000 

1*046.000 

10833.000 

700200**0 

.000096 

.000044 

.000333 

.309033 

.000001 

.000000 

.00000* 

700203**0 

] 

0 

0 

9 

0 

0 

0 

700200**0 

1  .000161*67.000 

10.000 

24.000 

21.300 

33.000 

5 

700  200  4*0 

.0369  30 

.080031 

.012266 

.901**6 

.02271* 

.033666 

700200**0 

0 

0 

0 

0 

0 

0 

7002003(0 

.3003* 

.761*3 

7002003(0 

243.000 

*19.000 

376.99  3 

1336.00? 

3*546.000 

9273.000 

*638.000 

2 

7002C3310 

.00  0043 

.09001* 

.0000*6 

.0909*6 

•0C03O3 

.000  001 

.000011 

7002003(0 

0 

0 

9 

9 

0 

0 

0 

7002C03(0 

3.000 

63300.000 

6.090 

13.000 

23.000 

12.000 

7002003(0 

.23  360  3 

.00000* 

.00*603 

.031086 

.32328* 

.007813 

700200310 

0 

0 

0 

0 

0 

0 

700600320 

.73*0* 

.9066* 

70C600320 

3*3.000 

2(07.900 

1120.090 

1634.009 

*07*8.300 

3733.000 

7*01.000 

703603320 

.000302 

.000(21 

.0091  7* 

.000036 

.000000 

.000001 

.000006 

700600323 

0 

0 

1 

1 

0 

0 

0 

700600923 

l.OCO 

41334.000 

3.  303 

26.000 

24.000 

3*. 300 

700600320 

.0*3863 

.OCCCO  3 

.0*7  739 

.002**4 

.305*12 

.020*97 

700  6  00323 

0 

J 

3 

0 

0 

70  C  2  CO  3  33 

1.00000  1 

.00000 

709203330 

660.00  0 

12*6.000 

2*63.000 

*3*0.000 

62136.000 

711*9.000 

*330.000 

2 

700203330 

.000367 

.000001 

.000  223 

.000014 

.300000 

.000001 

.300003 

3 

703  200  330 

0 

0 

3 

9 

0 

a 

3 

225 


4 

200200330 

1.000199403.000 

7.000 

*3.000 

10.000 

14.000 

9 

200200930 

.000010 

.000000 

.035906 

.000010 

.000010 

.0*083* 

6 

200200930 

0 

0 

0 

0 

a 

0 

0 

200  2  CO  340 

.4463* 

.33918 

1 

700200  340 

239  .000 

194.000 

998. 000 

933.300 

13*32.000 

10021.000 

7019.000 

2 

200200940 

0 

.000037 

.000134 

.000001 

0 

.000001 

.000011 

3 

700  2  CO  340 

29.197 

0 

0 

0 

33101.733 

0 

0 

4 

7032C0340 

1  .000 

73100.000 

9.300 

21.000 

24.300 

12.000 

3 

700200  340 

.193470 

.000034 

.021 780 

.000986 

.01*089 

.012171 

6 

700200340 

0 

0 

0 

ft 

0 

a 

a 

700700330 

.63301 

.67861 

l 

700  700330 

070 .000 

1081.000 

744.000 

1333.000 

96272.000 

11894.000 

10334.000 

2 

700  700  330 

.00  0337 

.000022 

.000187 

.000032 

.000001 

.000000 

.000004 

3 

700700330 

0 

0 

0 

3 

0 

0 

0 

4 

700700390 

1.000174726.000 

8.330  - 

40.003 

11.000 

23.000 

9 

70C 700330 

.00  4219 

.000000 

.039493 

.003173 

.02293* 

.018328 

6 

700700530 

0 

0 

0 

a 

0 

0 

a 

700  100  360 

.69906 

.710  78 

i 

700  1  00  3  6  0 

163.0C0 

1423.000 

1679.330 

363.000 

39961.000 

23629.000 

7722.000 

2 

70C10G360 

.00  0008 

.000079 

.000113 

.000002 

.000001 

.000002 

.000022 

3 

700100360 

0 

0 

0 

3 

0 

0 

0 

4 

700100  360 

1.000 

80340.000 

11.030 

23.000 

31.000 

24.000 

9 

7001 00360 

.12  6268 

.000006 

.009131 

.002764 

0 

.023365 

6 

700 100360 

0 

3 

a 

0 

.889 

3 

g 

700700370 

.70312 

.44919 

1 

700700370 

334.0  00 

824.000 

923.000 

2331.000106530.000 

23804.000 

6107.000 

2 

705703370 

.000324 

•0C307Q 

.000191 

.000013 

.000001 

.000301 

.000004 

3 

700703570 

0 

0 

0 

a 

a 

0 

0 

4 

700  703370 

1 .000109343.000 

6.003 

33.0C3 

23.000 

26.000 

9 

700  700370 

.039698 

.000001 

.068163 

.000737 

.011739 

.007897 

6 

700700570 

0 

0 

0 

0 

0 

0 

a 

700200390 

.37633 

.68842 

i 

7002C039C 

614.000 

980.000 

333.000 

2769.000 

33271.000 

19239.000 

14032.000 

2 

700  200390 

.00  3043 

.000064 

0 

.000029 

.000000 

.000000 

.000006 

3 

700  2  CO  390 

0 

0 

433.  936 

0 

0 

0 

0 

4 

700200390 

1.000199101.000 

7.000 

26.000 

26.000 

73.000 

9 

700203  390 

.12  8407 

.500001 

.011336 

0 

.020947 

.017907 

6 

700203  390 

a 

0 

0 

3.66  7 

0 

0 

a 

700  200  600 

1.00000  1 

.00000 

1 

700200600 

893.000 

171.000 

1980.000 

3736.000 

3*038.000 

23793.000 

49347.000 

2 

700200600 

.aooooo 

.000001 

.300010 

.000003 

.000000 

.000001 

.000019 

3 

700200600 

0 

0 

0 

0 

0 

0 

0 

4 

7CQ203600 

2.0001  79973.000 

8.000 

60.000 

9.000 

15.000 

3 

700  200600 

•aoaoio 

.003034 

.004243 

.000010 

.030*90 

.000010 

& 

700200600 

a 

0 

0 

0 

0 

a 

0 

900600  610 

.328*7 

.70674 

1 

900600610 

10  99  .a  00 

374.000 

1033.000 

1360.000 

*3342.000 

13339.000 

10871.000 

2 

9006C0610 

•  000014 

.000039 

.000092 

.0000*9 

.000003 

.000001 

.000013 

3 

9006C0610 

0 

1 

0 

0 

0 

3 

0 

4 

900603610 

1*000 

66400.000 

13.000 

36.0  00 

13.000 

27.000 

S 

900600610 

*131924 

.000003 

0 

.008910 

.017293 

.013981 

6 

903600610 

0 

0 

.102 

9 

a 

0 

1 

900603620 

1.00000  1 

.00000 

l 

900600620 

i9oi  .oca 

797.000 

*94. 000 

1294.000 

27889.000 

6237.000 

8318.000 

2 

900609620 

•00 0422 

.033013 

.000228 

.300000 

.000001 

.000001 

.000000 

3 

900  600620 

0 

0 

0 

0 

0 

3 

0 

4 

930600620 

1.0031  *6011.000 

7.300 

39.0  00 

9.000 

72.000 

3 

900600620 

.000010 

•ocooco 

.033  720 

.300013 

.000010 

.0612*0 

6 

90Q6C062Q 

0 

0 

5 

* 

0 

0 

9 

90 C  6  CO 630 

.33339 

.95237 

l 

903  6  CO  6  10 

730 .000 

4fOJ.OQO 

*03.000 

1730.000 

7*607.000 

11117.000 

23329.000 

2 

900  (03630 

.000017 

•QC0012 

3 

.000011 

.000000 

.000000 

.000006 

0 


3  300  600  630 

0 

0 

404. 349 

0 

0 

0 

«  300  600630 

1.000617986.000 

13.300 

42.000 

4.000 

19.000 

9  300  60  0  6  30 

.066333 

.030001 

.000618 

.002316 

.009382 

.009167 

6  300  600630 

0 

0 

0 

0 

0 

0 

0  300 600630 

1  90C6QQ  633 

1871  .000 

2334.000 

1786.000 

1760.000 

1.80000  1 

55730.000277174.000 

2  300  600630 

.000299 

.000  013 

.300310 

.000000 

.000000 

.000001 

3  300  600630 

0 

a 

0 

0 

0 

0 

4  300600630 

2.0  SOI  33730. 300 

19.000 

43.000 

5.000 

19.000 

3  300  600630 

.090010 

.000002 

.031103 

.000010 

.315708 

.004211 

6  300  600630 

0 

0 

0 

a 

0 

0 

0  300  7  00660 

1  300  7  03  660 

744.000 

714.000 

4443.000 

1043.000 

67*67.000 

1.00000  1 
6758.000 

2  300  700660 

.00  0237 

.010031 

.000143 

.000003 

.000000 

.800001 

3  300  7C3660 

0 

0 

0  ' 

i 

0 

3 

3  300  703660 

1  .000 

76314.000 

14.000 

4.000 

17.000 

18.000 

3  300 700660 

.00  GO  10 

.300002 

.062  401 

.000010 

.000310 

.eaotio 

6  300  700663 

0 

3 

0 

0 

0 

a 

0  3  0  0  6  00  6  70 

1  300  600  670 

3073.000 

1078.000 

188.000 

2002.0001 48911. 000 

1.000 00  1 
16074.000 

2  30C600670 

.000261 

.301001 

.300010 

.000000 

.000000 

.000001 

3  30060067] 

0 

0 

0 

a 

0 

0 

«  70S  600670 

2.0:0166023.003 

17.000 

41.000 

10.000 

16.000 

3  70C 600670 

.00  0010 

.003002 

.003010 

.300010 

.300010 

.045320 

6  70S  6006  73 

0 

0 

0 

0 

8 

0 

0  300 300670 

1  300300670 

2271.033 

4*66.000 

1406.300 

2376.000100000.000 

1.00000  ] 
28  337.000 

2  700300633 

.000071 

.000034 

.000310 

.000030 

.000000 

.000001 

3  900300670 

0 

3 

0 

1 

0 

0 

*  700300630 

2.0001  330  33.000 

17.030 

34.000 

13.000 

to. 000 

3  70C300610 

.00  0013 

.000003 

.013710 

.002958 

.000010 

.100010 

6  90  3  3  00670 

0 

0 

0 

0 

0 

0 

0  700603703 

1  900600700 

1223  .000 

821.000 

1762.300 

2412.000100000.000 

.60697 

12917.000 

2  70  0  6  00  70  0 

.000173 

.000083 

.030028 

.000035 

.000000 

.000000 

3  700603  730 

0 

0 

3 

0 

0 

0 

4  90  C  600  700 

2  .0  3  08  4  76  3  0.00  0 

11.000 

24.000 

8.000 

14.000 

3  90  0  600  70  0 

.0T7«9a 

.000001 

9 

.013007 

.004648 

.013907 

6  703600730 

a 

0 

13.614 

0 

0 

a 

0  70C6C3  710 
l  700600710 

993  *00 a 

2271.000 

1177.000 

701.000 

3600.000 

1.00000  1 
6176.000 

2  703600710 

•  0009*4 

.300301 

.000010 

.000000 

.000000 

.000001 

3  70C600  713 

0 

0 

1 

0 

0 

a 

4  900600713 

1«000 

0 

7.000 

61.000 

10.000 

19.000 

3  700600710 

•  oooota 

.377703 

.000310 

.000010 

.100010 

.000010 

6  700600710 

0 

0 

a 

0 

0 

0 

0  700  700  720 

1  700  700  723 

147  .000 

17.000 

310.100 

273.000 

87T.000 

.60174 

0 

2  900  7 GO  720 

0 

1 

.000127 

.000042 

.000002 

.000003 

3  7  0  0  7  00  72  0 

351 .044 

322.102 

3 

0 

8 

a 

*  700  700  720 

1  .000 

30441.300 

3.030 

10.000 

10.000 

7.000 

3  70G  700  720 

•  41  7771 

.000007 

.117804 

.006647 

0 

0 

6  700  7 GO  720 

0 

a 

3 

0 

3.317 

2.659 

0  703  300  730 
l  70C3C0  730 

1194  «0Q0 

1143.000 

716.010 

2667.000 

3657.000 

l. OOOOO 
11570.000 

2  700  300  730 

•  00  0000 

•OOGOO l 

.003010 

.000367 

.300000 

.800001 

3  703303730 

0 

0 

1 

0 

0 

9 

*  90C3G3  7J0 

1  .000 

170.300 

18.010 

32.000 

5.000 

14.000 

3  7C33C3/J0 

•  00  CO  10 

•  332262 

.011647 

.030011 

.000010 

.000011 

6  7C:3CJ730 

0 

1 

0 

7 

0 

3 

0  9Cr  7C3  6*3 
l  303 7C3640 

21  rt  «o:a 

6377.000 

1*16. 131 

2787.000170100.030 

.65618 

16709.030 

.ooooo 

12337.000 

.000010 

0 


.00000 

10800.000 

.000000 

0 


.00000 
12700.000 
.0  00011 
0 


.00000 

*0000.000 

.000013 

0 


.83239 

10631.000 

0 

60010.022 


.00000 

6202.000 

.000000 

0 


.70035 

330.000 

.000007 

0 


.ooooo 
1082*. 000 
.000003 
3 


.08060 

63*0.000 


Appendix  L:  Constrained  Facet  Analysis  Lambda  File 


1200200010 

700400400 

1.01900 

2200200010 

70020  0440 

.08568 

3200200010 

90060  C71Q 

1.22336 

4200200010 

300500090 

1.31246 

5200200310 

900500730 

-.99500 

6200203010 

700200600 

.54179 

7200200010 

500  30  0250 

-5.00882 

0200200010 

3-00  7000  70 

.39762 

9200200010 

200700020 

.60978 

1300203170 

300  7000  70 

.34364 

2300200170 

200400040 

-.04671 

3  3  0  0  2  00  1  70 

700200600 

.33139 

4300200170 

700200440 

.04657 

5300  200170 

900500690 

•  01042'" 

6300200170 

700 200530 

-.05781 

7300200170 

300 700120 

-.47274 

8300  2  CQ170 

500  40  0220 

-.03656 

9300  2  CO  1 70 

600  70  0360 

.03158 

1030C2CQ170 

200 500030 

-.06321 

11 300  2  CO  170 

300 700150 

.80329 

1230C  2  CO  1 70 

50  0  60  0  2  3  0 

-.03661 

1400600200 

230700020 

.43161 

240C  600200 

2  00  5  0  00  3  0 

.26171 

3400600200 

900  700660 

.21204 

4400  600200 

700400400 

.12340 

5400600200 

500400220 

-.01953 

6400600200 

200400040 

-.07834 

7400600 200 

90050 0690 

-.16181 

8400  600200 

60020  030  0 

-.22946 

940C 600200 

500700210 

-.40308 

1040Q  600  200 

300700120 

-.11025 

11400600200 

900600650 

.01630 

12400600200 

700200600 

.36734 

1500600230 

900  50  0  7  3  0 

2.56243 

250C 600230 

700 200440 

3.19718 

3500  600230 

900 700660 

.11946 

4500  6C3233 

900600710 

.12093 

1500600240 

200  70  30  2  3 

.11119 

2500600240 

500600230 

-.23536 

3500603240 

90C60 0650 

.75  739 

4500600240 

900 500730 

-.03484 

5500600240 

300  7000  70 

.60874 

6500600240 

700200440 

-.18370 

7500600240 

700200600 

-.40133 

850C 600240 

200  50  00  30 

-.03720 

9500600240 

900 500690 

.07245 

10500  603240 

900700660 

.22167 

11500  6C0240 

300500090 

.34428 

1600600310 

900700660 

.03435 

2600600310 

900600650 

.46919 

3600600310 

300700160 

.12872 

4600600  310 

700200600 

.17056 

5600603  310 

300  7000  70 

.44650 

6600600310 

700200440 

-.17998 

7600600310 

200  50  00  30 

-.09034 

8600  600310 

900500690 

-.25929 

9600  6  00  310 

600 7003*0 

-.08249 

10600600310 

730200530 

.12747 

1160G  600  310 

303  700120 

.11670 

16CC  600  323 

503400220 

.06958 

260C  6  00  320 

900  700660 

.01 965 

229 


10700200390 

900680630 

-.23879 

1900600610 

300780070 

-.17732 

2900600610 

900680650 

-.00952 

3900600610 
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Pope  AFB  before  transferring  to  the  active  AF  Reserves  in 
August  1975.  She  performed  reserve  duty  at  Pope  AFB,  NC  and 
Yokota  AB,  Japan  in  the  Programs  and  Engineering  and 
Environmental  Planning  Branches  while  working  at  her  Civil 
Service  job  in  Military  Family  Housing  Management.  She 
returned  to  EAD  at  Eglin  AFB  FL  in  October  1979  and  served 
as  Chief,  Readiness  and  Logistics,  OIC  of  Civil  Engineering 
support  to  the  Cuban  refugee  camp.  Special  Projects  Officer 
for  the  Commander,  and  Chief,  Resources  and  Requirements 
Branch.  She  then  was  assigned  to  the  Operations  and 
Maintenance  Division,  DCS  Engineering  and  Services,  HQ  AFSC, 
until  entering  the  School  of  Systems  and  Logistics,  Air 
Force  Institute  of  Technology,  in  June  1983. 
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